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ABSTBACT 

A teacher education program intended to increase the 
va^riety of questioning techniques employed by science instructors is 
p^esent^d an^ evaluated. Used by four different groups of secondary 
te?ichersr this module presents a question category classification 
structure based on the Aschner-Gallagher system, ^ut modified to be 
specific for Science"^ teaching . The bulk of in-struction is intended to 
be done by the programmed materials which are provided and a ^ 
proyis|.qf'n is mad^ for self-assessment. From the four groupfe who ^ 
voluntarily participated in the program, the author found significant 
increases in the variety of questions used in teaching by groupdf 
composed. of student teachers and graduate students, but 
non-significant increase for two groups of inservice science 
teachers. Suggestions fot the improvement of the module from both 
those who have participated in the training group#)and the author of 
the modjule are included, (CP) . . 
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I- Brief Description of the Module 

Research in teacher training, cost estimates/ 
and transportability were all used as criteria for deve- 
loping the module. The final product included the^ 
following components; 

(1) A propaganda paper designed to convince the tfeacher 
that using a wide cognitive variety of questions would 
help them to. enhance student" achievement in science. 

(2) A very brief summary of mddule ob j ectives . This summary 
was not an extensive list of behavioral objectives. 

(3) A question category classification system based on 

the Aschher-Gallagher system (1) but modified to be specific 
for science teaching. 

(4) Written programmed instruction designed to trafin 
teachers to accurately identify the question categories. 
The programmed instrtrction comprised the bulk of the 
module /.and included not only identification of single 
questions but transcript analysis, category description, 
discrimination, and question writing tasks. Transcripted 
episodes, and all examples of questions were derived from 
audiotapes of natural classroom scieric€^ teaching. Trans- 
cripted episodes were selected using the criterion of 
modeling the desired behavior. 

(5) Mastery tests — transcript analysis tasks of con- 
si deraBTecon^Iexity and length. 

(6) Audiotaped^^Protocols — ' the audiotaped component 
contained a short verbal essay on the importance. of 
analyzing one's art for self-learning and improvement, 
then a series of short simple' t^aaching episodes leading 
to longer and mre complex teaching episodes which the 
teacher was expected to analyze » All episodes included 

in the audiotaped component were also selected from t^pes 
of natural classroom teaching. 

(7) Self-analysis — As a final task, teachers wfere 
encouraged tp audiotape their own science teaching and 
tp analyze it using their newly acquired skills. 

Completion of the Atire module required an 
average time of 6 1/2 hour Minimum completion time ' ^ 
was 4 1/2 hours. Maximum completion time was 12 hours 
15 minutes. 
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IIt Summary Of Evaluation Studies 

Evaluation Studies were conducted with four 
groups: student teachers in- secondary science', volunteer 
inservice teachers employed by a medium sized city school 
system, volunteer inservice science teachers eipployed • 
by small riJiral schools, and non-volunteer inservice 
science teachers from small rural schools who completed' 
the module as a graduate qourse requirement. Both 
non-volunteer grous (student teachers and graduate 
students) began to use a wider cognitive variety of 
questionis in their teaching following tJieir encounter 
with the module. The volunteer rural teachers increased 
the .cognitive variety ot their Questions slightly but 
not significantly (p =0.30) while the volunteer urban 
teachers did not change (p = 0.91). Questionnaires 
indicated that not all participants in the latter two 
groups completed the module. (In^fact, some of the 
module packages were returned by the "volunteer" urban ^ 
teachers with the seals intactl) A detailed discussion 
•of the evaluation studies can be- found in (2) ^ • 



III- Suggestions for Improving the^Module , 

Evaluation questionnaires filled out by parti- 
cipi^nt teachers, informal conversations between the author 
^ and some of those teachers, and non-^sysbematic observations 
indicated that a number of modifications in- module 
design might enhance its effectiveness. The ma^or problem]^ 
centered around the time required to work through it ' ^ 

and the teqhnical quality of both printed and audidtaped 
components . 

Time demand seemed to be a function of several 
inter-vrelated variables, the most impojtant of which was 
probjibly the complexity of the question category classi- ^ 
fication system. At the time the author was developing 
the module, he .was unaware of a very similar system 
developed by Blosser (3) which had already had many of 
the kinks ironed out of it. I woyld usa'Bloaser's' system^ 
in any revision of the module for three reasons. (1) Her 
system is easier to cAnprehend. (2) The other system ia 
an unnecesstiry duplication. What science education does 
not need is yet another slightly different question 
category classification system. (3) Blosser' s book is, an 
excellent one^or using in secondlary science methods cgjairses. 
Using her system jfor the module would allow continuity 
from methods course to student teaching. ^ 
^ ' Because Blosser 's system. is also quite complex, 

some basic changes should be^made in the programmed instruc- 
tion regardless of which system is used* The numjDer of 
extended .transcripts within the program should be reduced, 
with more emphasis placed on discrimination among the 
more difficult categories by including ^ore single 
« question identifications and sho»t episode analyses. 
Additionally, emphasis should^ be placed on possible 

codings rather than correct cti^dings, especially with the ^ *^ 
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more difficul^t categories.^ This ^rotfE^l give the /teachers 
more opportunity to- perceive success and might make 
working through the module seem shorter. 

The problem 'of technical quality can be easily 
eliminated from any revision o^ the mpslule. The "home 
m^ade", nature of the printed materials (all typing, 
mimeographing and art work done by the author) may ^ 
• have detracted from the effectiveness of the module. 
The rather poor technical quality of even the best 
audiotapes certainly detracted, ^rom module effectiveness. 
Technical quality problems,- almost certainly increased 
work-*time by an unknown aniounJij^,While the author' made 
a point of derivin^^udiotape^protocols f rom* inrclass 
recordings, this rs not absolutely necessary. Persons 
working through the module Ishould perceive the audiotape^, 
episodes to be real. This can be eff^cteCSby using the 
transcripts as scripts, obtaining drama studfents/to 
role play , -and recording the audiotapes under studio^ 
conditions . 

, The vqrbal essay should be eliminated and the^ 
remainder of the cqmmerjtary accompanying the protocols 
should be redu<?ed to little mor6 than direction giving. 
The percentage of time devoted to background , music 
should be considerably shortened and the nature of the^ ' 
background music changed. (The background music used 
by the author can best be described as very funky jazz 
rock; affective response to the music was generally 
quite intense with direction being age dependent. If 
the module is intended for. general use, music , with 
general appeal should be used.) 



A complete copy of the module appears below , 
including sctipts of the audiotaped fcomptment. The author 
grants permission for reproduction of t/hese copyrighted ^ 
materials so long as the users ^ire using them for 
non-commercial purposes. Anyone "desiring to use some 
or all of the materials for commercial purposes should 
contact the author. 
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fiince the 11^ — "Categorizing Quectionc in Science Clacceo" — wac firnt 
written and acGumbled, cevoral ne\j piecen have been added vfhich are not 
mentioned on. the f-irct page of the INTRODUCTION' TO THE MODULE. 

These include: 

(a) The sheet you are reading novf to explain all the other additions. 

(b) A'oheet entitled "GteTpw for V/i^king Through the Module" which given 

more complete directionc than the introduction booklet, directionr^ 
which include the added components. 

(c) A nheet which, explains more fully the nature of the exorapLes, 

^transcripts, and episodes around which the module io constructed. 

(d) A very short one-page summary of the question catef^Ory classifica- 

tion system for use in coding transcripts and audiotaped episodes 
(but not for use in working through thc^ritten progrotiLj^iwfept 
when^transcriTpts are being coded). 

all the above have been insel*ted 
in the in'troduction booklet 

(e) A sheet entitled "Directions for Coding Audiotaped, Videotaped, 

fiCnd/or Live Classroom Episodes for the Types of Questions Science 
Teachers Ask." This sheet was included in the original mpdule 
but was inadvertantly omitted from the introduction booklet 
directions. It will be found in the stack ^s it emerges from the 
envelope under the vrritten program exit asseW^nient and above the, 
audiocasset^te . , . * 

(f) Six (6) coding sheets for use in coding audiotapes, live classes, 

etc., which are paperclipped to the "Directions for Coding 
Audiotapes. . . ." ' ' 

(g) A sh^et asking you to estimate the amount of time you spend in 

working through each component of the module. 

(h) An evaluation form \,rhich you should complete after working through 

the module. 



THANKS FOR OVERLC 
THE SEMI ^DISORGANIZATION. 
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ALL QUESTIONS, EXM-IPLEB, TRANSCRIPTS, AND AUDIOTAPES ARE FROM LIVE IN-CLASS 
RECORDINGS. ^ FOR THE VmiTTEN EXAJ4PLES AND TRANCCRI'PTG, THE NAT^S HAVE BEEN 
CHANGED "TO PROTECT THE INNOCENT" BECAUSE mm OF THESE EXAI>1PLES JIAVE BEEN 
DERIVED FROM TAPES OF TEACHERS WHO ARE NOW TEACHING IN THE AUSTIN INDEPEN- 
DENT SCHOOL DISTRICT AND mm OF THE STUDENTS PROTRAYED IN THE TRANSCRIPTS 
ARE STILL STUDENTS IN WSTIN SCHOOLS. AN, ACCURATE PORTRAYAL OF CLASSROOM 
DIALOGUE HAS BEEN ATl'IWTED, EVEN TO. THE "pXTENT OF REPRODUCTTJG DIALECTS, 
PAUSES, AND SO FORTH. IN ONE INSTANCE, SOME EXPLITIVES VJEI^E DELETED (juot 
like- the politicianrj BUT THE pEPI^ODUCTfON OF CMSSROOM DIALOGUE (and multi 
loRue) IS AN OTIIERWISE ACCURATE REFLECTION OF VJHAT RliALLY HAPPENET)^IN THE 
CliASSROOM. THE EXAT^PLES OF TEACHING FOR BOTH" THE V/RITTEN COMPONENT OF THE 
MODULE AND THE AUDIOTAPED COMPONENT VffiRE GENL-RALLY CHOSEN AS POJUTIVE 
EXAf4PLES OF THE USE OF QUESTIONING BY TEACHERS: THERE IS ONE WRITTEN 
TRANSCRIPT VnilCH DOES NOT REPRESENT V/HAT THE AUTIWR WOULD CONSIDER TO BE 
GOOD OVEmLL TEACHING STRATEGY BUT VnilCH ^ES REPRFJSENT FAIRLY GOOD USE OF 
QUESTIONH IN TEACHING, 



STEPS FOR WORKinO THROUGH TIIE 'MODULE 



^1) R<?ad t;he INTORUCTION BOOKLET to ©"btain an overview of the module. 

{2) V/ork through the introduction booklet,, following the directionc 
carefull^. V/hile working through ^ the written program^ you will 
need both the ICEY BOOICLET and the INTRODUCTION BOOKLET, go keep 
^ these handy. ' * 

(3) Analyze the tranncripto in the V/RITTEN PROGRAM EXIT ASSESSr^ENT. 

;\fter working through the written program, you should be able to^ 
code tranncriptG at the 80^5 accuracy level. The final ob'^ective 
of the module in a T0% accuracy level ^ fbr coding live clancroom 
proceGO. Because coding wi^bten tranccriRta is much eacier than 
coding claoGroom proceqa as it flows by you, you should not advance 
to the next step (the audiotaped cbmponent of the njodule) until 
you have achieved the Q0% accuracy level for coding transcripts. 

"(^4) Listen to the ^audiotape and follow the directions. Again you will 
need both the key booklet and the introduction booklet. The audio- 
tf^-pe has two sideu. ' . 

(5) Analyze your student teacher's teaching at every opportunity. 
Specific suggestions for doings this are included in the module 
and need not b^ discussed at this point. 

(6) Give your student teacher, feedback on the questions he or she asks. 
If .they are using questions well, tell them. If they are not, make 
some positive suggestions regarding ways in which they can improve 
their questioning skills. 

(T) Fill out the- evaluation^ form included at the end of the module and, 
if you 'wish, write out any comments, questions, suggestions for 
impro;vements , examples, and so forth you feel would be helpful to 
us in revising this module for next year's student and co-operating 
teachers . 
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Ur>E THIG KEY AC A mwm AID FOR CODING TRANGCKIPTS AND ' ON-GOING 
CLAGGROOM PR0GEI3IJ. 



CATEGORY • DESCRira'IQN' 



1 t Managerial, Procedural and Rhetorical Quentionn 





/, 

Mnmory-recall and Identlf i(?ati6n Queotiono 


2h 


Obiiervation and Tranolation QueBtioiicj 


3A 


Queotiono aoking the otudent to une a learned or previouoly 
(^iven formula, method, logical ooquence, or clanaif ioation 
syGtem to produce a coijrect ancver. 


3B 


Quentiono which aok ctudent to infer or predict from • 
data and obnervationo or to cite their reaaono. 


3C 


QuentioriG which require extended reasoning to produce 
the one acceptCible annwer, i.e. analyiiio qucBtionn, 
identification of aoisumptionG underlying a sequence of 
reasoning, etc. 




Completely open quectionn with many pooolble right annv/ero. 




Clacnif ication type quectionr, for which ntudent make up 
crite;ria; Experimental denign queotionn; Prediction 
from an inadequate data or observation bane 



Uc Hypothec is f-ornjation when hypothec ir, han not been pre- 

viouoly studied. Synthesis type questions. 



5A Simple agre^/disagree and yes/no evaluation questions for 

which either alternative*is equally acceptable. 
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Qufuiti/mn which acik otudentn to ,)\xdrA' rat*^ 

whirh aok r^tudenti: t<> chO(>nr> fm(mtr> r.everal , 
al tf^rnat iver: . 
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WORKING THROUGH THE MODULE: OVERVIEW 



The. IMP "Categorizing Questions in Science Classes" consists of 
three written parts which describe tasks for you to 'dor The first part • 
is a written prograqi designed to familiarize you with the QjUestion cate- 
gory terminology and to let you practice categorizing questions derived r 
from audiotapes of .secondary science lessons. Tlis second parx is the 
audiataped instruction and is designed to give you practice in using the 
category under combat conditions-'-coding questions recorded in secondary 
'science classes as they flow past you at the rate of classroom use'. 'The*' 
third part is an audiotape you will make of your own teaching; you should 
record yourself teaching a lesson for whigh the use of question is appi^or- 
priate so that you can use the category system to analyze the kinds of 
questions you use. 

Support materials for these three oportions of the module include 
•this lntroducto!ry booklet which describes the question category system 
and explains the coding rules as well as introduces the philosophy » 
behind the module, a key booklet which contains the coding keys for 
transcripts included in the written program and for episodes recorded 
on the audiotaped instruction, and a written program, exit assessment 
which contairfis two extended transcripts by which you may evaluate your 
competence^ at coding transcribed science lessons prior to beginning the 
audiotaped instruction. 

Now would be a good time for you to check your IMP package to be 
sure everything is included. You should h&ve: 

' Cl) INTRODUCTION TO THE MODULE: The Category System—Description of 

th,e Categories and Coding Rules * • 

'(2) Written Program , ; - * 

(3)* Key Booklet 

{h) Written Program Exit Assessment 

(5) Audiocassette. containing audiotaped instruction. 

If y^ou have, everything, please turn to the next page which ^e- 
scrib^d^ a'bit of the philosophy and rationale underlying the IMP; 
Categorizing 'Questions in Science Classes. 
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IHTRODUCTIOH , • . 

One of that most important skillG poGQeDScd by any teacher ia the 
ability to aok good questions • Whether a teacher is conducting an inquiry 
lesson, attempting to get st«dentG to draw inferences from experimental" 
data, evaluati^ng student understanding of pome point 'before proceeding 
with the le^GSon, conducting a review of a unit of Gtudy, or conducting 
some other activity, questions a5?e every teacher's Gtock-in-trad€5', 
' ' Several ^research studies over the* years have shown that most 
teachers asJk memory-recall questions alraojit exclusively. There is 
nothing "wrong" with learning discrete facts and, contrary to the 
opinions of many persons, the thought processes related to memory are 
still thought processes. BUT — memory is only one thought process among 
many and research has shown that a person who has natural ability for 
one type of thought process does not necessarily have natural ability 
for another type of thought process, for example, a student who is a 
d good memorizer might not have much ability for reaching conclusions by 
examining experimental data. A second student might hot be good* at either 
memorizing facts or interpret-ing experimenta]* data but might possess 
ability iti evaluating solutions which have' been proposed for a particular 
'problem. A third ptudent might be able to generate several excellent 
alternative responses to an open question but might' not be as able as 
fiis/her peers in memorizing, interpreting, or evaluating. Research has 
also indicated that training for one type of thinking does not necessar- 
ily effect improvement in other thoughtprocefeses even though a common- 
sense analysis of the thought processes indicates that they should be 
related to each other. (Once again, as is common with many psycholog- 
ical phenomena, what makes "sense" is not necessarily what happens^.in 
real life. ) ♦ ^ * 

» V/hat does all this have to do with asking questions? V/ell, dif- 
' ferent kinda of questions require different kinds of thinking, different 
thought processes;,- to produce answers. A teacher who wishes to ,take 
advantage of the varying cognitive abilities of individual ^/^yde^s 
should ask many different types of questions. A teacher wfia|Viilh^s to 
help students to develop the many different kinds of though^;^^rocesses 
should ask many different types of questions. And at a more practical , 
level, the teacher who wishes to keep the class from getting bored with 
one type of question will also ask many 'different types of questions. 



A. STUDENT TEACinSRS • f 

How can you^learn to ask, many different typeo' of queotiono? Research 
in teacher education indicateD that moot teaoherS do not recognize the 
difference between dlfferQnt typeo of^ quections. Aloo, teachero who / 
learn to identify different .types of quest ions as^ they are used in the 
classroom use more different types of. questions' than teachGrs who do not 
learn to identify question types. This, module is designed to help you - 
learn to identify many different types of question^ that are' used in 
teaching secondary science. The category system which you will learn has 
been derived from the research on different thought processes and also 
from listening to hours of real-life science instruction. You will learn 
to use the category system by identifying questions — written and then 
au(fiotaped — asked by real teachers conducting science lessons with ado- 
lescents in the public schools. You will then be a^ked to analyze your 
own ^aching via audiocassette for the types of questions you ask. 

B. co-.6peratikg teachers ' ^ 

One of thg^j^asons why student teachers ask only one ar two types 
of questions, is because their teachers have used onl^^ne or two types 
of questions; they ar'3 familiar with'^nly one^ or two types. Also, they 
often do not realize they are asking only one or two question types. \J 
Research has shown that co-operating teacher feedba:s4c is oae of the most 
important^ variables in helping stuient teachers to improve their question- 
ing, and that feedback concerning objectively observable and "specifically 
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definable tj/peo of quecrtions io more effective thar^ general feedbdcjt. t 
T^is module Id designed to help you learn to categorize the quec- 
tions c^ked by your Dtudent teacher. By actually catt}gorizii3f^ written • 
and ^udiotaped quectiono and ohort teaching sequences, you will learn a 
CQ^tegory oyDtem which wao derived from the reD^arch on types of thought 
processes and from listening to hours of audiotapes of secondary science 
teachers using questioning. All of the questions ^ed in designing this 
module were derived fiTom "real,-life" secondary science lessons being 
.taught by real teachers to real adolescents in the public schools. 

Once you have learned this System of classification, we urge you 
to use the gysteln in observing your student teacher. In so doing, you 
will be able to give the ^student teacher specific feedback concerning 
the use of questions. For example, rather than communicating a vague 
feeling of disquiet and dissatisfaction, you might be able to tell them 
that they ask'ed 10 rhetorical and hO memory-recall questions during a 
10-minute period and tben to suggest some more appropriate types of ques- 
tions or some different types of question they might use. 
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THE. CATEGORY SYSTM 



'1- Managerial-rhetorical queotiono 

This category includeo all thooe questiono vhich studento are really 
,xiot expected to ancwer and thooe queotionp which imply a point of view with 
which the studentc are expect to agree. Also included are quest iono which 
Dtudento are^expected to answer with a "y^s" "no", providiRg the 
teacher vdth infonnation needed to conduct the lesoon. Examples are: 

"Charles, would you like to sit down and be quiet so v/e can 
proceed^ with the discuooion?" 

"Can everybody see this?" 

"Did^ya'll all understand Bobby's answer?" 

"Canol, you said that the bubbles disappeared when you added 
the livei**, right?" 

"Df>n't you think we should put .a thermometer in the beaker to 
record any possible changes in temperature?" . 

* ' : ^ - ^ ' ^ ' . 

2- Cognitive*-memory ques'bions 
A- Levfil A 

fhe ^irst level bf this category includes questions Which ask 
students to remembeis. previously learned materials or to identify something 
they see, hear or, otherwise sense by a learned name or label- The 2-A ^ 
category includes >the infamous memory-recall question (the "ICNOWLEDGEy 
level in Bloom's Taxonomy ) , Examples of memory-recall quei^tions are: 

• * 

"VJhat is^he phylum of a frog, Michelle?" \ 

"V/hat' are the six major experiments' which led to the develop- 
ment of modern atomic theory^ Bob?" 

Examples of identification questions included in category 2A are: 

"Susan, what is the name of this apparatus?" (holding it up) ^ 

r 

(teacher playing a recdfding of train approaching then receding, 
while blowing whistle )'*"V/hat kind of effect did you just hear, Sean." 
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,B- Level B 

' • 2B queotionG include thooe which aak ctudento to deccribe pre- 
viouDly learned, read, heard, etc., material or otatemento in their own 
wordo. Moot queotiono of thio nature would be called "translation" 
queotiono by Bloom. An exomple io: 

« 

"You Juot mentioned oomething about netting up a ^control' in 
the experiment, Bob. V/ould you tell uo in your own words Juot 
^exactly what you mean by the word 'control' when you're talking 
^ about an experiment?" 

Thio type of queation io often uoed with a' probing otrategy by many 
science teachers. Another type of question included In thic category 
2B are those queotions which ask students to describe observations in 
their own words. Examples include: 

"V/hat did you see happen when we put the flask in ice?" 

"V/hat did group k get when you measured Alfred's heartbeat, Sandra?" 

A 

Questions of this nature are commonly asked during a post-lab or a demon- 
stration. 

3- Convergent-production questions 

This type of question requires a best or a right answer, the 
acceptability of which can be judged by an objective set of criteria 
developed' by someone prior to the asking of the question. The criteria 
may or may ^ not be knovm to the student but the teacher should know them. 
The trick is — no matter how "hard" a question is, if' there is only one 
right answer Und if it is not coded as a 1 or as 2 A or B, it should be 
coded as some level of category 3. ^' 

A- Level A 

Common to this category are questions which require students to 
use a learned or given sequence of reasoning in producing the right an^ver. 
Common examples of this question type occur in science classes when 
students are confronted with new examples of a type of problem they have 
already learned to solve — e.g., 

"O.K., Harvey just calc,ulated the concentration of ethyl acetate 
starting \Tith one mole of each reactant. Now, Mary, if you added 
2 moles of acetic acid, 1 mole of water, and 3 moles of ethanol 
and mixed them up, how much ethyl acetate v;ould be present when 
the reaction reached equilibrium?" 
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Another example of thio type of question which commonly occuro in ncience 
clacoec io: 

„ "Ucing the characteriotieo lifted c/n the board, toll me which 
of the following common organicmo are mammal and which are 
not, Rowena^" 

V/ith thio queatior^, the student in expected to clacoify, uciin?^ a given^ 
cyatem or net of criteria. Any question which aoks for comparison, con- 
trast, classification, etc., using a given or learned system or set of 
criteria is also 3A. 

B- Level B 

Questions of ca|iegory 3B require the student to deal in some 
way with relatively unambiguous dhta and with the inferences drawn there- 
from. They occur most typically in post-lab or demonstration lessons. 
Another type of question vhich is also categorized as 3B are questions 
V7hich ask a student to cite the reasons or criteria ?(|;Sed in producin/:^ a 
previous assertion or answer. Questions of this latter type are also 
often used as probes. Examples, of 3B questions are: r. * $^ 

"V/hy do you think"^ the period of the pendulum will be longer 
if we raise 'the bob before letting it go, Harold?" 

"V/hat do you think the temperature of tHe water vrould have been 
had we let the water boil for another 30 seconds, Marie?" 

"You missed the measurement of your plant on Thursday but you 
have the height for every other day. If you had to guess, using 
your other date, what would you say the height of the plant vras 
on Thursday?"' 

"Xou just finished measuring the boiling point of water. Does 
this^data t-ell you anything about vfhat the boiling point of 
alcohol might be-, Larry?" 

"Which of the temperatures listed on the board seem to bq the 
most likely as the melting point of PDCB, given your experi- 
mental results, Sharon?" 

In some cases (e,g,, prediction of established trends), this type of 
question |tflght be structured using learned or given principles, and so 
forth, ra^^er thatl lab data. For example, after lecturing on the gas 
laws, a teacher might ask a student to predict whether or not a balloon' 
would expand, given certain well-defined conditions. Most questions 
defined as "Application" in Bloom^s Tajconomy are included in category 
3B of this system. 
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C- Level C , . ^ 

Theoe are queotior^o which require a student io produced the 
solution to a problem, pr^^0nelU0jf^, an explanation, etc., which is 
best or correct' when the student dq^B not Know and has not learned the 
logical sequence which is associated with a high probability of pro- 4 
ducing the best or correct sol^tloti, conclusion, or explanation. Another 
type of question classified as 3C is what Bloom calls "Analysis" ques- 
tions, when the analysis is expected to .produce a best or correct- answer. 
A third typo of question classified as 3C includes those questions which 
ask students to identify the assumptions underlying certain st^ttements 
(in a sense, discovering the underlying assumptions requires analysis 
so this third type of question might be viewed as a sub-type of analysis 
questions). Examples of 3C questions are: 

Now, we have all the^ steps of the experiment written on the^ 
board. I'm going to ask someone whether or not performing 
this experiment will really provide an answer to the original 
question, or whether there ' s*^ still something that you're leaving 
out. I'll give you a few seconds to think about it before I 
•select my victim." 

"Bobby, you said that the balloon would expand ancT everyone 
agreed with you when we voted because you gave such good reasons. 
VOien we did it though, the balloon contracted instead. V/hy do 
you suppose that happened? Vhat were you assuming when you 
listed your original reasons for believing the balloon would 
expand that's not actually correct?" 

"You've run a bunch of experiments where you varied the amount 
of force and the weights^ sitting on the car and where you measured 
the acceleration of the car. Can you take that data from those " 
experiments- and find a rule or a law or formula which would allow 
you to figure out ahead of time almost exactly what was going to - 
happen, Julio?" 



U- Divergent-production questions 



Divergent-production questions allow for a larg^ range of accept- 
able answers. The criteria of acceptability may be either objective or 
subjective and may be determined by the teacher^ the student(s) or som<^nne 
else. The key to all category U. questions is that they have more than 
one, and usually many possible, right answers. 
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A-L evel A ' , • ' ' ' ' 

Thic: level includes queotiono which are completely open and 
quectionr. which require £i factual type of answer^ Imt for which the range 
of reoponcec is very wide. An example of a completely open question Ig 
the famous . " 

"Vftiat ic one*' use for a brick?" 

Anowero to thin question can range from "you can build houses vrith bricks," 
to "you can grind it up, mix it with water to m^ke clay, and ifse it to 
sculpt a ^caricature of the principal." Examples of ^^A questions vrhlch 
require a , factual type of answer to be chooen from a vdde range of accei)t- 
able recponseG are: /^^^ 

, "V/ill you name a fruit or a vegetable. Bob?" 

"VThat is one example of a metal. Sheila?" ^ 

"VThere is one volcano located, Gammi?" 

B- Level B , ' 

Category UB includes three types of questions commonly asked in 
science classes: classif icati6n type questions for which the student is 
expectetj to generate tlae criteria for classification, questions which ask 
the student to predict an occurence frojn certain conditions \rhon they must 
generate the criteria for choosing which conditions to which they will 
attend (i.e., they do not know the general principles v/hich are applic- } 
able and have not conducted any organized experiments relating to the 
occi^rence being predicted); and quej^^tions v/hich ask students to propose 
ways in which previously established questions or statements can be tested 
(i.e., experimental design questions). These three types of questions * 
haVe in. common a wife variety of possible answers vrhich are acceptable 
but which must' still meet certain criteria of acceptability. In addition, 
the answers ai*e, not "factual" in the sense that they have been learned; 
the answers are logical possibilities. Also, .in each case, the student 
is generating the criteria for the ansVf^ he dr she produces, but the 
student's, criteria are or can be evalua1>^d using some objective criteria 
as well. Examples of kh questions are: 

"How do you tell the difference between fruits and vegetables?" 

"V/hat criteria could you use for deciding whether any of these J 
minerals are valuable or not?" 
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"VThen we mixed thoCe two chemicalo toc^'ther, the oolution rAayed 
color leGG for about ten oecondc before it turned to dark blue. 
V/hat would happen if we added about 10 ml., of water to Qach of 
the oolutiono before we mix-ed them together? V/ould it take leho 
time, the oome time, or more time to change to dark blue?" 

"How would you go about finding out 'whether or not liquids are 
affected b^ thermal expangion, Erneot?" 

'4B quedtionG are quite connnon in many ncienee claCGeo. Some teachero 
give a hypothetical cet of conditiono to begin a pre-lab, eliciting pre- 
dictions of the outcome from aeveral otudenth and probing come of them 
to determine the reacono and/or underlying aooumptiono on which their 
predictions are based (3B and 3G queptiono). Then they use quectiono to 
determine the design of an experiment wbich might distinguish betvreen 
the probability or correctness^ of the different predictions. The classi- 
fication questions are- most common to life and earth scienfces where the 
teachers seem to be more concerned with classification than do physical 
science teachers. Although much early chemistry was classificatory in 
nature, chemic^try teachers do not seem to use classification questions 
very much. Pex*haps tjiey should. 

C- Level - , ' . 

— ^ 

Questions in category include hypqthesis formation and what 
Bloom calls "Synthesis" questions. Sometimes the level of the students 
must be considered when coding such questions. P'or example, 

"V/hy is the hot water staying on the top and the cold water 
staying on the bottom, Roosevelt?" 

would certainly be a Hc question for ninth graders who had not previously 
studied the reJLationship between temperature* and- deiuiity . On the other 
hand, this same question would almost as certainly be coded as a 2k for 
college-bound senions in an advanced physics class. Typically, "why" 
questiono such as 

"Hrarairmim. It took tho mixture 20 seconds longer to change colors 
this time. How do you explain this, Margarite? V/hy did^it take • 
longer to change this time?" 

"Why do you suppose the period of the pendulum was the same even 
though you lifted the bob a lit^ie higher before releasing it?" 

shduld be coded as if the students have not been expected to memorize 
the answer beforehand. ^ 



23 ^ 



Evai nation quest iono 
'a- LeveivA 



Category 5A includQO queotiono which aok ctudentc if they agree 
or^ disagree with oome statement^ point of view, ancwer, etc., etc. Both 
ancwero should b.e equally ao acceptable — "disagree" shouM .be as correct 
or acceptable as "agree". If this Ig not the case, the question should 
not be coded as 5A. ^ 

B - Level' B r 

Category 5B contains 3 types of questionp: questions which ecok 
the student to express a value Judgment in tenns of a scale of values 
Xirovided by the responding student, questions which are similar to those 
Just described except that someone other than the student (usually the 
teacher) furnishes the scale of values prior to the student's response, 
and questions which ask the student to choose from amorvg alternatives 
which are* provided. Examples of 5B questions Ofre: 

"V/hat do you think about this method of oolvong the problem?" 

"If you v/ere a^pregnant mother and you contracted a severe case 
of measles, would you get an abortion or vrould you have the baby? 
Remember, there is a good possibility that your babe, if allov^ed. 
to be born, would have a birth defect. Sandy?" 

"O.K. We've only got two kidney machines and there are 10 
people who have to use it in order to live. If they do not get 
to use the kidney machine they will die and you must pick out 
the two people Vfhb get to live; the 8 people people who do not 
get to use a kidney machine will certainly die. You have a 
handout which gives you the information whicl^ is available on . 
these ten people so "read it cai:efully and pick out the two you 
wish to use the kidney machine. (LONG PAUSE). O.K., Jesus, 
which two people did you pick out?" 



, A word about the cfuestion category classification system. 

^ ' • 

The numbers and letters Used to designate the different categories are 
intended only as category identification symbols and are not intended to 
convey any scale of values to be attached to any one category of question. 
For example. Category hk should probably not be considered las "higher 
level" than Category 3C. 5A questions might or might not be considered 




"higher IgvgI" compared to §B queotlono* Qne chould not aooumo that quco- 
tiono catGRorized with larger numberD and lettero are more deoirable. 
Typeo of queotiorxo, like other otrategleo and techtilqueo which teaehera 
uoe, Dhould be appropriate to the objective.. 

' On the other hand, a model of teaching io very definitely bein|3 implied 
in the category ayctem. The model teacher io one who eonoid'tently uoeo 
□everal different typeo of queotlono, aoking queotiono at oeveral levelo 
and T^ith differing rangeo of difficulty and rangeo of acceptabl^e anowero. 
The model teacher implied by thio category oyotem might not une all eleven 
typeo of quectiono in one leoDon or two leboono, but, he or ohe v;ould 
- definitely uoe moot of the categories over a period of oeveral Jeaoonc. 
The leoGon on due day might be a pre-lab with many HB, 3B and 3C quentiono. 
The aooociated pobt-lab leooon would include 2B, 3B, 3C and hC queotiono. 
On another day, a leooon deoigned around an iooue in ccience or on the 
relationohip between ccience and society might include many 5A and 5B 
queotiona ao veli ab SA, 3B, f*A, etc . , ^queotiono . On yet another day, 
the teacher might ^conduct a review oeooion, aoking mootly 9A, 2B, and 
3A type queotiono. The criterion of good teaching implied by thio quoo« 
tion category elaooif ication oyotem io variability in uoing different 
typeo of queotiono. Thio io not t^ie only criterion of good teaching but 
it io one of them, arid it io the criterion wh^c'h can be addi^qoed uoing 
the oyotem above. 



DECISION RULES FOR USING THE CATEGORY SYSTEM: how to decide between two 
dimilar categorieo — reoolving oome ambiguitieo. 

1- VJhen in doubt, code any quei^tion as a lower number and letter. If you 
aren't oure whether or not more than one anower io acceptable, aoGume 
that only one anower io acceptable. If you can't tell .whether or not 
.the otudent.^ are expected to have otudied the oubject on which they 
are being queotiono, aooume that they are expected to have otudied the 
oubject. The reason for thio rule io that moot teachers ask mostly 
memory-recall (Queotiono and convergent-productiorf questions*, regardless 
of what a teacher may intend, if the question and/or the context are 0t 
all ambiguous, the otudents will react to questions a& ifi^hey were 
memory-recall and convergent-production questions simply because those 
• are the kinds of questions they are accustomed to. 

(a) If you are not sure from contex-t whether or not otudents are being 
asked to infer from an adequate data and/or theoretical base, assume 
that they are (code 3B in preference to«J4B). 

(b) If you're not sure f^om context whether an agree/disagree question 
is a 1 (student io expected to agree with the point of vim; implied 
by the teacher) or a 5A (either the agree or disagree response is 
equally as acceptable to ^the teacher), assume, that it in a 1. 
Usually the student's response tone is a good clue to distinguish- 
ing between these types of questions. 

Z3 ^ 
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(o) If tho erjntpxt flooo not provido nuffirient cluoo for d(»ei(iinR 
vfhother ntudentn have previouoiy b(>en exponod tf> a mfithod for 
working*; a problem to produce a ripht or bent anower (the differ- 
once between a and a 3A), aooume that thoy have and codq the 
quention a -jA, 

(d) If the context doeo not provide ouffiolent cluen for diotinf^uinh- 
inf^ between nyntheoio or divergent hyp9-ther)iD (lueotionn (^u:) and 
oimilar quentlonc to which thf» teacher will accept only the "rif^^ht" 
fjr bent an.swer (30), aDouine that only one annwer io acceptable 

and (jode Ml, 

(e) If the cruitext doen not provide ouffiei(?nt cliuni for dintinr.uinh- 
ix\^, beiwpf^n quentionn and queotionn for v/hir^h the answer hao 
been learned (^'^A) or for which a method of f^eneratinf*; an annvrer 
ha:) been If^arnfni (3A), aonume that the anower or method been 
learned and code accordinf^ly • 

(f) k\\ ruleo have exceptiono. The exception to thin rule io: A 
fjueotion that ooundc completely opon\nhou,ld be coded ao a ^iA even 
if it io not clear In context that the teacher r(^ally wanted to 
aok .a different kind of queotion and juot didn't phraoe the queo- 
tlun properly. If the teacher aoko a oecond rjueotiem^ addinf, 
critf^ria for the anower which were not available initially, th(^ 
necond queotion ohould be coded ao a PA,' or whatever elne it 
mip;ht happen to be. The fact that the tear^her had to rephrfUJe 

to ^pA> the deoired anoi^er intiicateo that the anowerinp; otudent 
accepted the open queotJ.on ao open and provided an "open" anow(>r. 

2- If a teacher followo the anower to a cor^nit ive-mpmf)ry CPA and ?\\) or 
a convergent-production (3A, 3B> and 3C) quention v/ith an f\(Tx^^/ 
dioagree redirect queotion, give the re<iirected quention the name 
code ao the preceding queotion. Hince both cofjiit ive-memory and con- 
vergent-production queotiono have beot or correct anov;ero , both 
optiono for an agree/dioagree redirect are not equally acceptable. 
The previouo anovfer which the otudent to whom the redirect ban been 
given io expected to evaluate io either correct or it io not correct ^ 
in chooning betvfeen agree and dioagree, the otudent in eooentially 
anower ing the original queotion. 

3- If a teacher aoko more than one quention in nucceoolon without either 
allov^ing a otudent to anower or anoi^ering themoerlveo, code only that 
queotiorr which the, otudent anowero. This will unually be t\wt laot 
queotion, but not alwayo . An exception to thin rule io the coding of 
oeveral managerial queotiono. For. example^ 

"Bobby, I'/ouljd you pleaoe oit down? Keith, do you think we can 
hold a diocuooion while you and Sandra are' talking like that? 
LeeRoy, what are you doing to Patrice \o dreoo? Sunan, would 
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» you pleasq go" to the office and ask Mr.' Price to. come down her,e 
for a fev minutes?" * 

shotild "be coded as a -.series of four I's. 1, III! 

As-implied by the last' sentence above, when a teacher 'asks the same 
question 'several times in succession, a more efficient way >to code 
this Is to Vrite the code, for the question the first time wh^n it is 
asked, then to follow the initial code with a ditto mark ("') each tiiuj^: 
the question, is aski&'d consecutively' thereafter . A common strategy ■ 
called ELICITIKG ^pften employs the same question several times in 
succession and if the coder use^ ditto marks to indicate that the 
samt^" question has beeft asked 'several times in succession, this -Stra- 
tegy will appear more obviously' on the finished code-sheet • 

5- Sometimes,' tasks or problems which the, students are expected to do to 
produce an answer 'are not phrased in the interrogative fofm. This is 
especially true for 3A type ques^iions and for clasaificatipn questions* 
in general. Even if the interrogative form is not used, directions to 
a studf^^p-f. to do something to produce an answer nr solution should be 
coded as a question for the purposes of this category system. 

6- Quite often in listeijing to -mudiotlapes (less often in listening to 
"live" classes),* not all the words spoken by the teacher are under- 

- standable due to techprical and/or student problems. When questions 
are not ^uqderstandabll^^^xiode them with a lower case "o". ^ 

^- Many teachers sometimes phrase questions so poorly that understanding 
exactly what the ^estion^is* getting at is difficult even though the 
coder .can \;l^^*iy und'erstand the individual words that are spoken (an 
example is:^^^alphie, what abdut planets?"). Questions ^ that- are so 
poorly phrased tiaat their intent is lost should be coded witii a lower 
case^, o ♦ 

. 8- 3!^here may b^e several kinds of questions which are perfectly under- * 
standable and for which the intent is quite clear but which are just 
not classifiable into one of the categories of this, system., Whenever 
this type of question occurs, code it with a lowef case "o". 

9- To summarize rules 6, 7, and 6 — any time a teacher verbali zat ion' that • 
is obviously a question cariijot *be* coded, use a lower case "o" to 



indicate that a non-codable ' question was asked. 
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frajne 1 



You are about to read programmed instructJLon designed to help you learn 
to use the category system you have Jiist finished reading. This pro- 
gram should not be read like a book because choosing differeijt answers 
to the questions contained herein will sometimes ask you to turn to 
different pages of the program. 

When asked to. answer a question, pleaie do so before turning to the 
page designated as the next one' in the sequence. You will often be . 
asked to write your answers , down before proceeding to either the' next 
page in the program or to a certain page in the answer key booklet.- 
Unless you are possessed of an unusually gopd memory, you should 
follow these directions; not following them will likely insure t|iat you 
will have t.o proceed through more pages of the program in the long run. 
Writing the answer when so instructed will get you through the program 
succesRfnlly faster than not writing them. 



PLEASE TURN TO PAGE 3 



frame 2 



The directions on^page (l) asked you to tixrn ta page (3). Since you 
are;reading thiis message, you obviously di d not follow the instructions*. 
Please turn to page 1. ^ 

frame 3 , • 

0 

t • . ' ■ 

Below are several groups of ciassroom questions which should be coded 
as category 1. Please read'^hese quetions and write down the common 
attributes you feel these question^ have which might effect their being 
included together in a single category. 

(a) "Has everyone here tasted salt?" 

(b) "Did ya'll hear what Kevin said?" 

(c) "Don't you think we should use a thermometer to measure the 
change in temperature?" 

(d) "Now would the air be heated or cooled by lightning? If 
would be heated, of course!" 

^ (e) "Who hasn't given me their data yet?" 

{f) "Bobby, did anyone give you pennissioii to talk?" 

After you have written down the attribute(s) you feel these questions 
may have in connnonv turn to page 5- 
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frame U . ' ^ 



Keeping in mind* the discussion you have Just read on^page 5 and also re- 
membering the nme of categojry I^-I^MAGERIAL-RHETORICAL , please study 
the catp»gory 1 questions listed below and identify why each is coded as 
category 1. ^. - 

(a) "V/hat did you say?"' ^ ' # 

(b) "Does anyone need tc^ hijive that repeated?" 

(c) "Don't the tropics hav:e .more hot water than cold?" 

(d) "But you can see that itj\ happened, Can't you?" 

(e) "Does everybody's data lqo}i like this?" ' 

(f) "Sandra, would you pleasd turn around and stop pestering 

Harold?" - . 

. (g) Now why do you think the solution turned blue? Because we 
added a base to the solution, 
(h) "Don't you really think that abortion is murder?" 

• . PLEASE TURN TO PAGE 7 



frame 5 

All those questions have in common that the students don't reality have 
to think very much at all to answer them and often are not expected to 
answer them at all. They are procedural, managerial, rhetorical, or use 
interrogative mode for* phrasing a point 5f view with which the students 
are expected to agree. Students are expected to confinn something, to 
agree with the teacher, to take some' action such as turning around and 
being ^uiet, or to give the teacher managerial information which the 
teacher can use in pacing and/or structuring a lesson. 

If your answer was similar to the above, please turn to page 6. If your 
answer was very much different from the above o£ if you did not write 
uown an answer, please turn to page l^. , * 



30 



176 



frame 6 ' 



You have an adequate underotanding of category 1 — IjIMAGERI^LtRHETORICAL 
quections. Wow yoii need to practice identifying questiono which may or 
may not be coded ac I'o. Below are three questionc which you should code 
ac either "l" or "Not-l" on a separate sheet of paper, 

(a) ^ "Connie, do you have something to say?" ' 

(b) "VThat part of a meter would a decimeter be?" 

(c) "V/ould you repeat your answer so everyone can hear it, 

Charles?" 



After coding the three questions above as "1" or "not-l", please'turn to 
page 9 ^ 




frame 7 

♦ 

Categoryl questions are managerial, procedural, dlsciplinai*y , and/or 
rhetorical in nature. They' dcJ not normally deal with subjec1>4aatter 
as such and when they do, they are rhetorical (the teacher answers them), 
they are factual statements made in interrogative mode with which the 
students are expect to agree, or more rarely that are requests for the 
student to reveal his or her state of understanding before proceeding to 
ask that student to answer another type of question. 

PLEASE TURN TO PAGE 5 



^ — : 

frame 8 , $ 



You have received no instruction to turn to this. page. Please re-read the 
page you Just read and follow the directions carefully. If you cannot 
remember whi6h page you were just on, return to page one and quiclUy 
follow the directions from page to page until you return to the page you^. 
Just read. 



frame 9 



(a) ThiG is probably a I, but you would noed to hear it in context to be 
cure of your ^categorization. If the .teacher is using it to elicit 
an answer to a question which has been previously defected to 
another student, you would code this as whatever the original 
question was. Most likely >it would be a 1. * 

(b) This it; definitely not a II The sti^^ient is expected to draw on his 
or her store of knowledge ^relating to the rpetric system and answer 
the question. 

^(c) This is certainly a 1. 

If you missed either (b) <or (c), please turn to page h. If you did not 
miss either of these, turn to page 10. * 
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frame 10 ^ ' 

Below is a transcript of a short audiotaped science lesson. The questions 
to be coded are preceded by lt>wer case letters in parentheses. Code 
each of these quetibns as "l" or- as "other". ' . 

# 

T: (a) Ir this a fr^it or a vegetable? ' • 

fJlANY STUDENT REPLY^;-imiNTELIiIGIBLE 

T: (b) Are you suri^? 

MANY STUDENTS REPtY-.-.UN INTELLIGIBLE 

T: (c) What do yc^ think it is Bonnie? 

SI: A v-egetable. v,^ 

T: (dV Cathy? ' ^ 

S2: I don't 'Icnow.'j 

S3: I didn't hear ^you Cathy. (e) Would you speak a little louder? 
T: (f ) Ye^,, speak a little louder so that can hear you in the back of 

, ' the room. 'li » 

S2: I DON'T (fCNOW! ' | * 

Sk: Aw come^n. You kno;#^^t's a vegefable. (g) They put 'em in salads 
don't they? 

Robert, they put fJaSlatoes in salads. That's quite true. (h) 
o you Imow what a jfjldorf salad is? 
SU: YeB. • ' '/ 
T: (i) What^is^in a Waldorf salad, Robert? J , 

sk: Carrots and apples and rkisins and stuff. - 
T: (WRITING Ofl BOARD) Robert 'said that this stuff is in a Waldorif ^alad. 
(j) Are there any fruits in that list of stuff, Joe? 

i 

After writing you codes for these questions designated above, please 
turn to page 13. [ 
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frame 11 



Below 1g a tranGcript sinTilar to the*one you Just coded. Code the 
queotiona preceded "by lower eace letters in parentheseo ao either 1 or 
other and write your coding on a oeparate sheet of paper. 

(a) Joan, what do you see npw? 
SI: The water's muddy. 
T: (b) Vniy dp you think it is muddy? 

SI: Because you Just put some dirt in it and it hasn't had time to' 

sink 'to the "bottom. 
T: O.K., the dirt hasn't sunk to the bottom yet. (c) Right? (d) Do 

you agree with that explanation,, Jimmy? 
S2: Ho. . 

T: (e) No? (LONG PAUSE)^ 

S2: Ho, I don't 'agree. I don't think all the dirt will sink to the 
bottom. I think some of the dirt has dissolved in the water. 

T: ISmMA. That certainly an interesting idea, (f) How could you 

tell the difference between John's idea and Jirrafty's idea, Sean? 
(g) How could you'^tell which of the explanations is correct? 

S3: (h) Huh? 

T: (i) Did you hear what they said? 
S3: Ho, Ma'am. 

T: (j) Why didn't you hear them? (k) V/eren't you listening? (l) V7ere 
you daydreaming again? (m) Joan, would you please repeat what 
you said for Sean? 

After writing down your analysis of- this transcript on another sheet 
of paper, please turn to page 12 ^to check your analysis. 



frame 12 
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(a) Thic lo Hot a 1^ — teacher is aoking otudentG to make a olmple 

oboervation which 1g 2^. 

(b) Other — hypotheciD formation id uoually coded ac Hc 

(c) 1 — teacher reotatec student 'g answer and ackc her to confirm 
reotatementQ'G accuracy 

(d) Other Student io being acked to evaluate another otudent's 
answer and both ^|tj|r^3e and disagree are equally acceptably. 

.Therefoi^o., this woulS be a 5A. 

(e) 1 — same as queGtion(c) 

(f) Other — teacher asked two questions in rapid succession, 

' Since the student did not answer either of them in an intelli- 
gible fashion, there Is no way this can be c^itegorized. Code 
it with an "o''. ' ^ 

(g) 

(h) This is a student question and should receive no code at all, 
not even an o. , 

(i) 'l 

(k), (l), and (m) — Since this is a string of managerial 
questions, they should all be coded. Your code sheet should 
designate them as a series of I's. 

If you did not understand the explanations given above, please 
return to page 11 and re-examine the questions in light of the 
explanations. If you do understand the explanations above and/or 
if you didn't miss any codes, please proceed to page lU. 
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(a) The otudento are being asked to claoQxfy a tomato either as a 
vegetable or as a fruit according to their own criteria. This 
would be a iiB, NOT a 1. * ^ 

(b) JL — student c ore not really *exp6c ted to provide an answer to 
thic. . ^ 

. (c), (d) OTHER — thes(^ are both UB queotiono juct like question (a). 

(e) Student questions are NOT CODED using' this system. 

(f) This is not a question. It should not have been coded. 

(g) Student questions should not^ be coded. - 

(h) 1 — This is' a relatively ■ rare form of managerial .quelGtions. 
*The student is a^ked to tell the teacher whether he actually 

has the knowledge to answer the next question before the 
teacher asks him the next question. The acceptance of the 
"y^s" answer is a context clue, 
(k) OTHER — Since this is a memory-recall question, it is coded 
as 2A. 

(j) OTHER — students learn very early in life that an apple is a 

fpuit. This would be an identification by label type of question,. 
2A.' 

If you coded -the student questions as I's do not count them as misses 
since they would have been l/§ had the teacher asked them. Please ' 
-remember that the category system is meant to be used with ti^acher 
questions only . 

After being given the student questions, if you missed more than 
one of the questions (i.e., if you miscoded more than one "1" as 
{■7^ "other") please turn to page 11. 

If you missed only one or if you missed none, ti:^n to page 1^4. 

*It might also be a 2A since most kids have learned to associate 
"tolnato" with "vegetable". 
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Below ore aeverol queotionG. PJeace read them and write down the 
attributes you feel they have in common • The queotiono below are 
all 2A quest ionG. 

(a) "How do you cpell turquoioe, Harold?" 

(b) "VJhat'G the name of thio mineral I'm holding up, Yolanda?" 

(c) "What are the two different kinda of energy, Albert?" 

(d) "O.K. Gerje,, io the ehromate ion yellow, or io it red?" 

(e) "Yeoterday, we talked about cell membraneo and you ohould have 
read the chapter on cellc laot night* What are cell membraneo 
made up of Bob?" 

After writing dowff t{ie attributes you feel theue queotiono have in 
common, please turn to page 15. ^ 



frame 15 
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All these questions require memory of previously learned materials or 
identification of something using a previously learned name. In both^ 
•cases, the student is expected to provide a correct answer that has 
been previously learned. . ' i 

Questi^ons of this type are coded 2A — cognitive-memory questions, 
level A. 

=^ 

PLEASE TURN TO PAGE l6 
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Below are oev^eral queotlono. Pleaoe identify thooe that are gA 
(memory-recall and identification with learned terminology) and 
thooe that are not . 

(a) "Vlhat do you call rivero that look like thio?" 

(b) "Do you think it will float or oink?" 

(c) "Can you tell me anything eloe about that?" 

(d) "V/hat'D a liter, BiU?" 

(e) "How many mlligtojiio are in a grora^ Ethel?" 

After writing down the l-etterc correcponding to thooe queotionc 
which ohould be coded ao 2A, pleaoe turn to page 18/ 



frame 17 
-IT- 

Category 2A queotiono 4re otrictiy memory-recall and identification 
using learned terminology. They ore very popular with teachero of all 
GubJectD and are quite common to ocience leooono. 

V/henever a teacher aoko a student to recite previously learned mater- 
ials, definitions, formulae, theories, proper terminology, etc., etc., 
the student 3 are expected to answer using words and .ideas they have 
studied^ and/or memorized/ Examples of this type of question are: 

(a) "What is the name of this?" 

(b) "And what- do you call that one there?" 

(c) "Harold, what is rthe Valence for the Ferrous ion?" 

(d) "What formula describes the* angular momentum of a rotating disk, 
Julio?" 

(e) "Please tell us the three moot important contributions made to 
the science of geology by Lyell, Marita?'^ 

(f) "V/ould you please name the phyla from the lowest 'to the highest, 
Linda?" 

(g) "V/hat is the principle of uniformity, John?" 

PLEASE TURN TO PAGE 19 



37 



183 



frame 18 
-la- 
ta) 2A — ♦ the teacher io acklng for a learned adjective 'ouch ao 
ciJ'meandering.** ^ Only if the context makeo it very clear that a 
divergent reoponoe Id acQ^ptable ohould thio "be coded ao oome- 
thing beoldea a 2A, 

(b) Other — If the teacher ia aoklng for an inference from data, 
thio io a 3B. If a prediction from an inadequate experience 
base io being asked for, thio io a UB. l^he context would pro- 
vide sufficient 'clueo foi^iotinguiDh:j.ng between them. 

(c) Oliher — 3^0 code thio question properly, you need to know what 
the previouD question was. VJithout that information, thio 
question would have to be coded an o since it doesn't fit into 
the category system on its own characteristics. 

(d) 2A — the student is asked to recall a definition. 
ie) Othqr — this is a procedural question, category III 

(f) 2A — Again the student is being asked to recall a learned 
fact, A possible exception to this coding might c^ceur if 
context indicates that the metric prefix system has just 
been* introduced. Under those circumstances, this might 
be coded as a 3A — reasoning or working a problem with 
learned or given method to produce the right answer. 

If you missed more than one question, please turn to page 17/ If you 
missed only one or none, turn ta the next page. 
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-19- 

Pleaoe read the queotionD below and write on a separate sheet of 
paper the attributes you feel they share which allow them to be 
'p-toced together in category 2B. 

(dp "VThat do you see happening, Sallj/*?" 

(b) "Ellen, what does the water look like?" 

(c) "Would you say that again using your own words instead of 
. the book's definition?" 

(d) ' "Vmat do you mean by that? VJould you say i^ in a different 

way?" 

-- - ^ . .:{ 

H .j^ a 

After ywriting down the \common attributes shares by these questions, 
please turn to page 20. 
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The common attribute shared by these four questions is that the stu- 
dents are being asked to explain or describe something in their own 
words. In some cases they may be requested to translate technical 
terms into everyday language. OBSERVATION and TRANSLATION are the 
key words in describing this category. Questions of this type belong 
" to category 2B. 



frame 21 
-21- 

If you missed the category 1 questions, please turn to page 5 and 
follow the directions from there. 

If you missed the 2A and/or 2B qilestions, pleane turn to page 26. 
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Below are several qi)f*ntiono. pieaoe oodo them ao 1, PA, 9B, and 
"Other'*. If you feel that you can correctly identify the category 
oyotem code for Dome othpr queotiono Included in the "Other," pleaoe 
feel f,ree to do ao becauoe the actu^il coding for all queotiono will 
be lio^^ed and dicouooed in the key. However ^ pleaoe concentrate on 
properly coding the firot three categorieo oince thooe ohould be of 
primary concern at thic point in the program. 

(a) "Have ya'll ceen a picture of what a membrane lookp like?" 

(b) V/hat are proteins eompooed of, Sue?" ^ * ^ 

(c) "Doeo anyone have a question?" 

(d) "VThat kind of energy ic kin-etic energy?" 

(e) "How would you describe a fruit to me If , I had never oeen • 
one, Marie?" 

(f ) "V/hy io the hot water otaylng at the top inotoad of going to 
the bottom, Jefferson?" 

(g) "V/hat do you call this Iuuh skinny thing I'm holding up. . . 
uh, Ben?" 

(h) "VThat happened when you put on to extra washer. . .someone 
from group ^i?" 

(i) "If you pass this streak of lightning through the air and the 
lightning is hot and the air is cold,' what is it going to do 

to the air around it? v/hat*s going to, happen to the air, Roger?" 
(J) "V/hy do you suppose the minerals we just listed on the board 

are worth a lot of money , ^p.ndy?" 
(k), "O.K., energy is the capacffty to do work. Would you explain 

that in your own words?" 

After coding the questions above as 1, 2k, PA, and "Other" a 
separate sheet of paper, please turn to page 
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(a) 1 — this is a procedural question 

("b) 2k - — memory-recall 

(•c) 1 — ; another procedural question 

(d) 2A — memory-recall 

(e) Other r-- student is "being asked' to generate own classification 
system for distinguishing "between fruits and vegetables • 
Therefore, this is a UB. 

(f) Other — student is "being asked to formulate a hypo'thesis so 
this is a UC 

(g) • 2A — ^"identifTlcation of something "by a previously learned name. 

(h) 2!& — o"bservation descri"bed using student's own words, 
.(i) Prediction — either or 2B, depending on context. 

(j) Other -r Student is "being asked to generate criteria for 

classifying minerals into valuable and not valuable groups, 
'therefore, this is Ub. 

(k) 2B — Student is being asked to translate .a learned defini- 
tion into own wdjfds, » 

If you missed more than one classification into 1, 2A, 2B, and 
Other please turn to page 21. Ignore any misses you may have had 
in trying to distinguish between the "Other" types of questions as 
long as you did not code'the "otlier" questions as 1, 2A, or 2B. 

If you missed oxi\^ one or^ none, please turn to page 2U, 
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Be^ow and on the following page is. a transcript, derived, from an 
studiotaped physical science lesson. Please code the qilrestions 
preceded "by lower case letters .in parentheses as 1, 2Pk^ 26, ancj 
other.- Write yoiir coding analysis down on a separate sheet pf ✓ 
paper. ^• 

T: ' (a) What about kinetic energy? . . .("b) What kind of energy is ^ 
that, Bruce? 

SI: (c) Is that the energy of moving objects? The energy of motion? 
T: (d) Is- that what you think it is? 

SI: I guess so. • • • 

T: (e) Do you agree with him, Erin? 

S2: Yes, I think that»s right. At least that's what you told us 

yesterday. ^ - - . ' ' ^ 

T: (f) What causes heat? (g) V/hy does the movement of molecules 
cause heat? LONG SILENCE 

T: '(h) Lonnie? • ' ^ ^ 

S3:>0ir?' ' ^ 

T: (i) Why does the movement of molecules cau$e l|eat? ' 

S3: I don't know. ^ • . 

LONG SILENCE 

S3: Well, maybe it's because the molecules or whatever they "are 

kirida rub up^ against each other and. • •. . 
(Laughter by other students make the rest of this answer unintelli- 
gible ) 

S3: i'i) Well, if ya'll are 30 smart, why didn't any of you ra^ise youi^ 
hands to answer. 



frame 25 



T: (k) O.K., would ya'ir please b^^,,.quiet and let him finish answer- 
'ing the question? It sounded IJke a pretty good answer to me. 
. .Go ahead, Lonnie. ' 
S3: Well, I mean. . .you' know. . .(PAUSE). . .like when you rub 

your hands together and they get warm, and when you fl^ll down 
and ^lide across the gym floor, you get burned. . .Uh, maybe 
the molecules are making heat by rubbing up against each other. 
Sk: Yeah, you get hot when you rub up against your girl friend too* 
(GENERAL LAUGHTER) 
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T: Actually, that's a real good exprahation, Lonnie. Eric is 

jealous "because he didn't think of it. Let's write-in on the 
board.. . .(l) O.K., JSric, can you think of another explanation? 
(LONG SILENCE) 
^ *SU: Nossir; 

T: (m) VJell, do you think you should malie fun of other people's 

' answers, then? 
Sk: VJell, it just sounded funny, yoix know? 

T:' I guess he could have said "rubbed together" instead of "rubbed 
up against." (n) Would that have made his' answer a little less 
funny, do you suppoge? 
sk: Yeah, I guess so. - ' ^ 

H: O.K. (o) Can you think of another explanation, Sherri? 

After coding these questions as 1, 2A, 2B, or Other, turn to page 1 
of the Key Booklet to check you answers. 



frame 26 

-26- . . . 

Category 2 is entitled COGNITIVE-MEMORY QUESTIONS . 
There are two different levels in this category. 

Level A includes memory-recall and identification questions. Any ti'me 
a studerft is requested to recite previously learned material or to 
name something using previously learned terminology ,^ the question . 
should be coded 2A. 

Wien a student is asked to describe something in his or her own words, 
or to translate previously learned materials into his or her own 
Vords a code of 2B is appropriate. 2B questions also include those 
questions which ask students to rephrase a previously made statement 
or answer . 

PLEASE TURN TO THE NEXT PAGE. 



frame 27 



-27- 

Below are several quostions, Pleaoe code these as 1, 2/1, 2B, and 
other. You may code the "other" category questions using the appro- 
priate system code designation if you wish since these will be listed 
and discussed. However, please concentrate on separating category 
1, 2A, and 2B questions from each other and from other categories. , 

(a) "Has anyone in here seen halite?" . ^ . , 

(b) "What doeq classification mean, Margaret?" 

(c) "Vniat*s an example of something that will dissolve in water, 
Danny?" 

(d) "What's the difference between potential energy and kinetic 
energy, Kevin?" 

(e) "O.K., Avogadro's number is the number of molecules in one- 
mole of any substance. Can you tell me in your own words 
what a 'mole' is?" 

(f) "Why-do you think there would be a fat layer, in cell membranes? 
Can you think of a function the fat layer might serve? 

(g) "What happened when you put the peiTuanganate crystal in the 
watet-, Janice?" 

(h) "O.K., the lens. . . .Now, what is this part of a microscope, 
Roosevelt?" 



After you have written the codes for these questions on a separate 
sheet of paper, please turn to the next page to check. your answers. 
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frame 28 
-28- ' ' ' 

* ' 

(a) 1 

(b) 2A — Both queotions in the derieo are really asking the same 
thing GO both are the Bome type of question. You really don't 
need the student 'g answer to cocle these questions. 

(c) Other many ^acceptable answers to this, so it is coded "^A. 

(d) 2A — While thid might be some other category in context, 

" usually wo!lrds like "the difference" aind technical terms such as 
'^kinetic" are keys that the student has already been exposed 
(like smallpox or meacJles) to the answer. 

(e) 2B — translation- of a technical term (mole) into student's own 
words 

(f) Other — Had the student answered the first question, a code of 
he — hypotiiesls formatioxi — would have been appi'oViate, If 
the stvident had answered the second question, a code of hk 
would be appropriate. A context clue to the acceptability of 
several different answers is the use of "a function" instead of 
"the function." 

(g) 2B — student is asked to report observations, \ 

(h) 2A ~ student is asked to identify something using a previously 
learned name. 

PLEASE TURN TO PAGE 22 
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-2a- 

The n^xt category in the claosificatlon syctem in called the 
COITVERGEHT-PRODUCTIOM QUESTION category,,, Except for cognitive-memory^ 
and managerial-rhetorical questione, convergent-production queotionb 
are the moot popular kinda of queGtiono aoked in science clasces. 

Convergent-production questions have in common that the student Id 
expected to use some Dort of reaoonilfeig and logic to produce a correct 
or beot answer.** The answer to a convergent-production question can 
be described as a logical necessity rather than merely a logical 
possibility. One answer to a convergent-production Questions ^ is 
demonstrably more right THAN other possible answers, 'The answers 
this, type of question may be objectively judged using a set of 
criteria which were developed prior to^the asking of the question; 
ousually the criteria for Judgment the correctness of. an answer t^ a 
convergent-production question have been establigihed bjr "experts" 
ratiier than by either the teacher or the student, 

PLEASE TURN, TO PAGE 30 
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frame 30 ' ' 

-30- 

The first level of convergent-production queotiono includec those 
queotiono which aok Qtudento to uoe a previously learned or given 
logical method or sequence of reasoning for producing the corf'ect 
answer to the question. Learning formulas and methods of manipu- 
lating them and Learning certain classification systems are 
examples of learning a logical method or sequence of reasoning 
designed to produce correct answers to certain kinds of questions. 
Ex^unples cif 3A questions are: . 

"Chauncy, using the formula PV - nRT, can you tell us what 
t]\e pressure will ^e in a previously evacuated 5 liter flask 
if we add 2 moles of carhon dioxide at 29°C.?" 

"A pair of hlue-eyed/brown-eyed hyhrad hmans^ many . and 

have 8 children. If "brown eyes is a dominant trait, how many 

"blue eyed children would you expect them to have^ Melvin?" 

"Using the characteristics for the various phyla of worms 
written on that handout sheet ,^ separate the different kinds 
of worms at your lah bench according to the phyla they belong 
to." 

PLEASE V/RITE A 3A QUESTION YOU 
MIGHT USE IK YOUR TEACHING. 
^ then 

turn to page 31 please. 
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Pleaoe identify the 3A quectiono below. On a oeparate cheet of 
paper. Hot only the niimbero 'of the 3A queotiono. ^ 

(1) "Wow, we added h.OO groJiiD of NaOH to 100 ml. of distilled water 
and added one drop of phenolphthaleln. How many ml. of O.OIM. 
HCl should we add to thio oolution in order to get it to change 
colore 'from pink to colorleoa without actually making it acidic, 
Eric?" 

(2) "Manfred; v/ould you please derive the mathematical expression 
which described the relationship between the length and diameter 
of a solid rod and its angular moment vim when it is spun around . 
a point at its center of gravity? 

(3) "VJhat size resistor must you put into a circuit t^ allow only 
three amps of cui^rent to pass through at 1000 volti?" ^ 

{h) "O.K., at each lab table, there are several different typR af 
plants. Now the question I want you to answer with those 
plants is thfs: What kind of a system, what set of criteria or 
characteristics, can you look at to use in separating those 
plants into only three groups such that the plants in any one 
group possess the characteristics of that group but the other 
plants do not possess those characteristics?" 

(5) "Mario, here's a box of rocks. V/ould you look at them and tell, 
us whi,eh, one's are igneous and which ones are sedimentary, 
please?" 

V/rite down the numbers of the questions you think should be coded 
3A. Then turn to page 32. 
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QueotionD (l), (3) and (5) are all 3A. Queotlono (2) and {h) are not. 
If you were correct on all counto, congratulationo because oome of 
them were pretty tricky. If you miooed one or more,, nee the diocuo- 
Dion below. If you have juot been congratulated, pleaoe turn to 
page 35. 

If you identified. queot ion <2) or (U) ao a 3A question, pleaoe turn 
to page 33. 

If you failed to identify quentionc (l)^ (3) and/or (5) ao 3A queo- 
tionG, pleaoe turn to page 3**. 

If you made both kindo of errorc, turn to page 33 first and follow 
the directions from there. 



frame 33 
-33- 

(2) A question like this would almost certainly be a 2A, although it 
could be a 3C for an especially advanced group of kinds, ^he 
derivation in questions requires a fair •knowledge of calculus 
(which indicates how important it is for a coder to have know- 
ledge of the subject matter field being taught) and this is 
beyond inost high school students (or most college students for 
that matter) unless they have learned a otep-by-step derivation 
which they ckn memorize and reproduce or regurgitate on demand. 
Since this is most likely a memorized d^ivation which the 
student is being requested to give, the question would probably 
be coded as a 2A. 

{h)^ The students are being asked to classify plants but they are 
being"^ asked to generate the classification system which they 
will use. Therefore this is a hB question. 

If you also missed questions (l), (3) and/or (5), turn to V^S^ 3^. 

If you correctly coded those three questions as 3A, turn to page 35. 
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Quectlono (l) and (3) ore obvlouoly "plug-into-the-fonnula«-and-crank- 
out-the-anower" type queotiono. Queotiono of thio nature are alvayo 
coded ao 3A, 



Queotion (5) ia not a "formula" type of queotion in the oenne of \ 
manipulating numbero but it is a "plug-in" type of question in the ^ 
oenae that the student is expected to use a previoucly learned 
cyotem of clacoif ication ccheme to answer the queotion. The words 
"igneous" and "sedimentary" are context clues indicating that the 
system has been previously given an^/or learned rather than student 
generated (students don't generally generate words like "igneous" 
and "sedimentary"). 

If you missed question (l) and/or (3), please turn to page 29. 

i 

If you missed only question (5), turn to page 35 please. 



Below are several questions. Please code them as either 3A or OTHER 
on a separsite sheet of paper. 

(a) "VJhy do you think the universe is expanding. Bob?" 

(b) "How many grams of NaCl would you get by evaporating all the 
water from 500 ml. of a 2.00 M. solution?" 

(c) "VJhat formula should you use for calculating the acceleration 
due to gravity working on a freely falling body, Clarence?" 

(d) "\^at is the major function of the cell's nucleus. Hank?" 

U) "O.K., Jeanette has given us several characteristics which she 
feels can be used to distinguish fruits and vegetables. Mollie, 
using Jeanette 's characteristics, can you tell us whether 
squash is a fruit a vegetable?" 

(f ) "Does your data look like the data that's already written on the 
board?" 

(g) "How many calories are required to raise the temporature of 10 
grams of \mter from 50°C. to 80°C., Sommy?" 
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(h) "Kittyj would you take this note to MIdg Bradohaw pleace?" 

(i) "SuppooG the Arabs start another *oil boycott and we have devel- 
oped enough oil to oupply ouroelvec and one other Inductrial 
nation? \Jho should we give our oil to, Imelda?" 

(j) "Vniat are oome ways we might be able to use the cloning technique 
we have Juot been talking about?" 

On a oeparate sheet of paper, code theoe quections as 3A or other • 
Then turn to page 36 to check your coding. 



' ] frame 36 

• ' ^36- 

(a) . Other — Asking for a hy;potheDiG, 2A if the hypothesis has"\een 

previously learned, hC if *it has not be^n previously learned. 
Context Ghould provide sufficient clues for distinguishing 
between the two and if it does not, you would automatically 
code with a lower number — 2A» 

(b) 3A . ^ 

(c) 2A — student is being asked merely to remember the formula, 
not use it 

(d) Other — This is a 2A question ( "the major function . ."). 

(e) 3A — The student is being asked to classify using a given 

' system which was developed by someone other than themselves, 

(f) Other — This ,is probably a 1 although you would need to hear 
it in context to be certain. 

(g) 3A ^ 

(h) Other — 1 (procedural) 

(i) Other — This is a forced choice kind of evaluation so this 
would be coded as a Ua. 

(j) Other — Since this is a completely open question, this would 
be coded as ^A, 

If you mised more than 1, please turn to page 37. If you missed one 
or none, tiorn to^ pagfe ^0. 
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frame 37 
-37- 

Category 3A queotiono are thooe which ask otudento to profluce eertaxn 
correct anowerc by uoing learned or given cequencfeo of reaooning, 
logical GyoteiUG, etc., ouch as mathematical formulae, oyotema of 
clacoification, or a oeriec of logical "otepsV which are aooociated 
with a GUCceoDful way to produce the right answer. They are "plug- 
in-the-numbero-and-crank-out-the-anower" type queDtior^c and 
"properly-apply-the-learned-otepD-or-criteria" type of queotiono. 

Clooe your eyeo, and in your own wordo, deocribe the attributeo of 
3A queotiono. 

TIIEK, PLEASE TURN TO PAGE 38 • 
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Below you will find five queotiono. Pleaoe identify theoe ao 1, 2A, 
2B, 3A, and other. Write your coding down on a separate oheet of 
paper . 

(a) "V/hat will the products be if, you mix HCl ami KaOH, Billy?" 

(b) "V/hy does the sunrise occur later each day during the Autumn, 
JeoGie?" 

(c) "Can you name a way in which the structure of frogo is adapted 
to life as an amphibian. Sue Ellen?" 

(d) "O.JC. , which of the compounds listed on the board are acids and 
which are bases, Gerry?" 

(e) "If we had kept on heating the beaker until almost all the water 
had boiled away instead of just for four or five minutes after 
the water had started boiling, what do you think the tempera- 
ture would have been, Lisa?" 

After you have vritten dow:h' your classification of the above ques- 
tions on a separate sheet of paper, turn to page 39 to check your 
answers. . * . 
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-39- ^ 

(a) Thio queotlon could be either 3A or 2A depending on the context. 
If they have otudied the actual reaction, it would be 2A— 
raeiaory-recall. If they are^uoing a redooning cequence ouch ao 
(i) baceo and acido react t6 form water and a oalt; (ii) take 

H from the acid and OH from the bace to make the water; (iii) 
Dtick what*G left together to make the oalt; then the question 
Dhould be coded 3A oince they^jrould be uoing a learned oequence 
to produce the right anower, 

(b) Other — The utudent io being aoked to propone a theory to 
explain certain oboervationc no thio ohould be a hc, 'Again 
context io important oince almoot anything can be and'often 
io memory-recall. 

(c) Other — thio queotion hao many acceptable anowero oo dt io hA. 
(cL) 3A — fltudent io being aoked to uoje a learned elaoolf ication 

cyotem. 

(e) Other — thio question io aoking for an inference fr»om data oo 
it ohould be a 3B. , 
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Below in a tranocript of an audiotapod phyoiaal r>eionce lenoon. 
PleaoG elaooify the queotionn proceded by a lowGr caoe letter p.o 1, 
2A, 2B, and 3A. Code other typeo of queotlonc qo other or, if you 
choooe, try to code theia with the proper category codec olnce the 
other eodeo will be lioted and dincuooed. 



T; 

Gl: 

T: 



S2: 
T: 
S3: 
T: 



Allrightj today we're goinf', to talk about -the metric oyotem. 
(a) Irving, wou^d you tell uc what you know about the metric 
nyotem, pleace?, - - ^ 

Wtill, I Junt know what wao in that liandout yqu gave uo. . you 
know, about the ruler in Pario and that other otuff. . . 
(PAUHE). . .Oh yeah, I went nhdpping with Mana yeoterday and I 
noticed that a lot of cano dnd otuff were linting the weight 
in gromc too. That!o the metric oyotem ion't it^ 

It certainly io. That'o pretty obcervant Irving, (b) VJhy were' 
you reading can labelo? 

I alwayo read the labelo to nee who'o trying to trick ua into 
paying more money 'for i^nn ntuff. 

That'o a pretty good idea. Ya'll nhould probably all do that 
whenever you go ohopping. . .In f(£t, I think I'll make that 
an aoaignment (VffilTING ON BOARD) All of you go to the grocery 
ntore ^^ome time thic week and find at leant one kind of thing 
thatliotD the weight in grorac. Then figure out how much it 
coDtn for a groin in two different aize cans or packageo. . . 
O.K., back to fee metric oyntem. (c) VThat'o a measure of 
length in the metric oyotem, Tina? 
The meter? 

Right, (d) How about volume, Sam? 
I don't know. 

Harvey? 
The cc. 



PLEASE TURN TO THE NEXT PAGE 
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~ frame Ul 

T:^ Well, that's certainly "on'^lIl^tric system volume mee^sure. (f) 

What does cc mean? ' ^ 

SUi^ Cubic centimeter. ' 

T: Right. (g) Do you know another metric systenji raeeisurement foar 
volume,^ Harv^? ^ * 

Si*: Sure. The ml. <^ 

T. O.K., and Ir'ving said earlier that the metric measi^'e for mass 
was ^ the gran^ ^ ^ ^ 

SU^ (h) How about kilos? They4]3e a metric measure' of - mass . 
T: That's a good question, Harvey. (i).What does kilo mean. 
SU: That'^ s**what jrou, use to measure how much a brick of<5>dope weighs. 
T: . (j) Susan, do you agree with that? 

S5: That's not what was on .that handout * sheet you gave us. 

T:.. (k) Well, have you ever heard of marijuana being measured in 

kilos*, Samantha? , ^ ^ 

S6: Yes, but they really mean kilograms. You know. . . a thousand , 

grams. 

T: (l) Can you think of anything else that has kilo in it,>rthur? 
ST: A kilpmet<er? ' 

T: Right, ttiat^ a real good example. (m) How many meters are in 

a kilometer, Harvey? > ' # 

SU: Golly gee whiz,- I don't know. Could it possibly be a thousand? 
T: Right, kilo' i« a prefix which means a thousand of whatever it is 

that follows the prefix. (n) How many kiloliters would you have. 

with 2000 liters, Roger? ' , 
S8: ^(LONG PAUSE) Two? ' / ' 

SU: .HOORAY and T: Right ^ (Simultaneously ) ^ 
T: (a) Harve, would you please refrain from making comments "like . 

that? They're very impolite and I don't want them in my class. 

(p) Do you understand? . 
SU: Yes ma'am, I sure do. 

T: Good (LONG PAUSE, WRITING ON BOARD) O.K.^f I've written all the 
, prefixes kndf'vhat they mean on the board an<i they're also in* 

that handout you go yesterday. (q) Robin, how many centimeters 

are there in a meter? 
S9:^ .2.5^? 

T: (r)' What does centi mean, Robin? . 

^ TURN TO THE NEXT PAGE. . ' • • . 
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, frame k2 

•■■ " .' ' . ■ ' ■ ■ 

*S9: One-ene hundredth? 

TV Riglit. That inep.ns that a centi-meter is only one one hundredth 

^ ■'as big as a meter • (s) If a centi-meter is only one one 

hundredth as big -as a meter, how many centimeters vould it take 
to mak^ up a length as long as one meter? 

S9: LONG PAUSE I don'ttknOw Miss Delg&do. I can't do it. 

Ski It's easy. You're just STUPID ! 1 . ' ' 

T-. Harvey. I've had enough of that^ Anypne you put down in my=^ 

class for being dumb, you're in charge of tutoring for the next 
quiz. Right nov you ^ re going to get the same score Robin gets 
on the metric, system quiz . You get whatever she does so you . 
better help Jier learn vhalj^'she needs to knov. If she flunks, 
you flunk. If you put down somebody else I'll a^d them to the 
list and get your grade by averaging their scores. ? 

Sl*: That 's not FAIR I ! ! I already knov this stuff and I can make a 
hundred on any test you give. It's not fair to give me a grade 
somebody else maizes. 

T: (t) Do you really think I'm trying to be fair? . 

Sh: (INAUDIBLE) 

T:. What I'm trying to do Harve is to get you to stop putting dbvn 

people in my class. You shouldn't call them stupid just because 
they don't know something that you do_ knov/" I'm also trying to 
help^ them learn some of that stuf^f^ yoti claim to . already .knov. 
For shooting oXf your mouth, you get zo help me if you vant to 
make -a goo^^ ^radc. (LONG PAUSE) (u) Nov, Robin, hov many centi- 
meters vill it take to be just as long as a meter if one centi-- 
meter is on^y one-one hundredth as long as, a meter? 

LONG PAUSE 

T:- You can't get it right if you don't try. 

S9: (LONG PAUSE) A hundred? ' - 

T: Right. That's real good. 

After vriting'^d^^RiNyour analysis, 

PLEASE TURN TO PAGE 2 OF THE KEY BOOKLET. 
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The questions "below are coded 3B — a' new category. Please read 
them carefully and write down on a separate sheet of paper the charac- 
teristics you feel thex have in common which allows them to be placed 
in the same category. 

(a) "Arabella, from looking at this data, how high in the tube do ^ 
you think the alcohol will be if we raise the temperature of 
the water to 25° instead of to ^0° or 30°?" 

(b) "O.K., we've Just talked about the effects bf'^hese different 
things on th§ movement of a piston. Now^ Louis, what would 
happen to a balloon if it were blown up and tied off and t^en 
the pressuijf putside the balloon were to be increased?" 

(c) "Let's see now. ..iYou got -7°, 17°, ^+7° , 78° and 105° for 
the boiling points of your amines besides getting a snoot full 
when you stuck your head in the hood. What 'do you think the 
boiling point of hexylamine will be if this trend continues, 
Cathy?" 

(d) "You' just tested for the hardness of talc and of quartz. Using . 
t'hes^ observations, what Qan you say about how hard obsidian will 
be, Johnny Lee?" 

After writing down the common characteristics on a separate sheet of . 
paper, please turn to page UU. • 



' frame kk ' [ 

All of these questions deal with inferences, either from data de- 
rived in the lab, from a similar situation which has been observed 
and/or discussed, from principles and theories studied in class and 
so forth. Included in this category are questions which f^equire the 
students to know what inferences cannot be made from data as well 
(e.g., one can't really infer the. hardness of obsidian from the 
hardness of talc and quartz). 

please'^turN'TG page U5 ' * 

• . : 1 
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Another type' qf question which approaches inference-making from a 
different direction is the type of question which askc a student to 
list the reasons for giving a certain answer or making a given 
^assertion. Related to this type of ques^tion and aliso coded 3B are 
questions which ask studVits to cite data and/or observation)^ to 
support an answer or assertion. Questions which ask for the basis 
for making an aswer or statement are coded 3B. 

If you have arrived at this page via pages' 58 and/or 59 » re-read the. 
definition above, and then return to page 58, following the direc- 
tions thereon. a. . ' 

If you turned to this page from pa^e UU, turn to the next page to 



continue the program. 
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' > frame U6 

Below are listed five queotions. One or more of these questions are 
not 3B questions. Identify the one or ones which are not 3B^and write 
the identification down on a separate sheet of paper. 

(a) "VJhy do you think it will get clear, Kenny?" 

(b) "Dolores,, if we did an experiment like this using alcohol 
instead of water, what do you think the graph would look like? * 
How would it be shaped?" 

(c) VThy does the warm air rise to the tope of the room and the cold 
air settle to the bottom, Joe?" >l 

(d) . "V/hy do you believe in legalized marijuana, Harvey?^ \ 

(e) "You missed Tuesday's measurement? What dd you think |t would 
have been from looking at the other data?" 

7 

After writing down the identity of the non3B questions, turn to / 
page UT to check your answer (s).' 



frame^T ^ 

4a) 3B — Kenny has already answered another question and is being 
asked for reasons to support his answer. 

(b) 3B — inferring from a known situation to an unknown one which 
is quite similar 

(c) Other — hypothesis* proposition is usually coded as hC 

(d) 3B — student being asked to list reasons for making a previous 
statement . - ~- - - - 

'(e) 3B — student being asked to interpolate from data. 

If you correctly identified the question that was not 3B, please ,turn 
to the next page. If you said that any of the other four questions 
were not 3B, please turn to page ^'n3» 



59 



If 

If 



205 



^ ' ' frame U8 \ 

If you teach primarily earth Gcience, turn to page U9. 

you teach primarily life ociDnce or hiology, lurn to page 50- 
you teach primarily chemiotry, turn to page 51- 
If you« teach mostly physica or phyGicp.1 science,^ turn to page 52. 



frame U9 - ' / 

You are an eartl\, science teacher and your otudentfi have j^uct completed 
an experiment dealing with the differential sedimentation rates of 
different sized sand grains. On a sejk'rate sheet- of paper, wite two 
different 3B questions which you might conceivably use dixring a 
post-lab discussion ofj the experimental*' results. 

After writing the two different questions on a separate sheet of 
paper, please turn to page 53- 



frante 50 ; 

^ ^50- . ^ 

You are a life science teacher. Your students have Just completed an 
experiment dealing with effects of different concentrations of phos- 
phate bn the growth of algae. On a separate pheet of paper, witel' 
two different 3B questions you might ask during a post-lab discussion 
of this experiment. 

After writing these two different 3B questions on a separate sheet of 
paper, please turn to page 5^- 
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frame 51 

You are a chemiotry teacher. Your pupila have juot completed an^ 
experiment dealing vith the factoro vhich affect the rate of the 
iodine clock reaction. On a oeparate Dheet of paper , write tvo 
different 3B quectiona vhich you might aok in a poet-lab diocuDDion. 

After writing theoe two different 3B quectiono on a separate cheet 
of paper, please turn to page 55. ' 



0 



frame 52 
t52- 

You ore a physical science teacher and your pupils have just completed 
on experiment dealing idth the factors which affect the-^period of a 
pendulum. On a separate sheet of paper, write two different 3B ques- 
tions you might use diiring a post-lab discussion, i 

After writing these two different 3B Questions on a separate sheet 
cf paper, please turn to page 56. 



frame 53 ^.^ 
-53- 

N . 

You're still an earth science teacher. This time, your students have 
completed an experiment during which they melted sodium thiosulfate 
crystals and then resolidified them by cooling the melts at different 
rates.. On a separate sheet of paper, write two different 3B questions 
(preferably different in type from the two you wrote before) x^hich you 
might use in a pos€-lab activity. 

After writing the«e questions, please turn to page 57. 
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' frame 5^ ""^ 

You are now a "biology teacher. Your pupilG have juot completed a 
field trip activity during which they collected several camplGG of. 
water and identified the microflora and microfauna therein. The 
aamplea of water were collected every thirty yards along an Auotin 
creek which Derveo to channel the effluent from a sewage treatment 
plant. The campling was begun sixty yards upstream from the effl^uent 
pipe leading from the sewage treatment plant into your creek. 
Please writo do>m on a separate sheet of paper two different 3B 
♦questions (preferablir dilfferent in type from the two you Just wrote) 
which you might use in a| field trip debriefing discussion.' 

\Jhen you have written theB^ questions, turn to page 57 please. 



frame 55 

-55- ' • 

You are still a chemistry teacher. Your students have Just completed 
an exercise in which they added several drops of 0.01 M. AgNO^ and - 
0.01 M. Pb(N02)p to a wide variety of 0.01 M. solutions of lA and TIA 
halides, nitrates, and acetates. On a separate sheet of paper, write 
two different 3B questions (preferably different in type from the 3B 
questions you just finished writing) which you might use in a post- 
lab discussion. ^ 

After writing these questions, turn to page 57 please. 
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frame 56 
-56- 

You are now a phyaics teacher and your students have juot completed 
an experiment dealing with the boiling point of a variety of oolventc 
including water, ^^11 at reduced preooure (you diocovered a McCloud 
gauge hidden in the stockroom which ajlowo your otudenlu to accurate-- 
ly measure the internal pressure created by pumping out the air in a 
glassware system at various rates). Please write two 3B questions 
(preferably different in type from the two you just wrote) which 
you might use during a post-lab discussion. 

After writing these questions, please turn to page 57- ^ 




You have juot written four type 3B quootions. All four of these 
queotiono ohould deal in come way with inference from data, obGerva- 
tiono, and/or prineipleo. Some poosible typeo of queDtionc might 
include : 

(a) The prediction of a clearly established trend, 

(b) Interpolation of gapo in exiotiKg data. 

(c) Diotinguiahin^ between concluoiono, consequences and/or predic- 
tions which are and whi«h are not supported by the data. 

(d) Identification of information that is needed to change the status 
of a conclusion, consequence, or prediction which is neither 
supported nor refuted by the data to the status of supported or 
refuted (HOTE; This is jiot the same thing as designing a way to 



(e) Prediction of consequences or results in a situation which is 
obviously similar to one which has Just been recently studied, 
discussed, and/or experienced. 

(f) Citing of reasons andA^r data to support a conclusion, predic- 
tion or assertion. 

-\ 

If all four of your questions were like this, turn to page 58. 

If any of your questions, asked students to describe observations or 
results, turn to page 19. 

If any of your questions asked your students to work a problem using 
a formula, classification system, etc., and the experimental data 
and observations, please turn to page 30. - 

*i • 
If any of your , questions asked students to propose a hypothesis to 
explain the data and observations, turn to page 
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frame 5B 

Another type of queotion not directly related to the type of question 
you have Juct written are aloo coded ac 3B, V/r^te down the charac- 
teriotieo of thiG type, of queotion on^a sepai^ffbe sheet, of paper. If 
you don't remember what thece character ^&tlco; are then turn to page 
^45. ' J] 

- - 

After you have vjritten theoe eharaeteriGtieo^j^urn to page 59* 

^ ^ ^ ' 

frame 59 ' "'^'^ 

-59- 

Any time a teacher askn a student to list the reaGono for giving a 
particular answer or for making a certain statement, to cite data 
or observations in support of a point of view^ to Justify an opinion 
or evaluation with the reasons and/or data used to reach that 
opinion or evaluation, the questions should be coded as a 3B. 

"V/hy did you say. . . 

"\fliat makes you think. . h'' 

"Can you cite any evidence to support. . .?'^ 

"V/hy don't (or do) you agree with. , 

are all keys to the beginning of this type of 3B question. 

If your characterization was incomplete or incorrect, please turn to 
page h^. 
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Below are 10 quectlbriQ. Please identify them an 3B or "Other." 
V/rite your code" down on a separate Qheet of paper. . •<» 

(a) "A watermelon, huh? VThy do you cay that, Karen?" 

(b) "VThat kind of motion does -the graph ohow — constant velocity, 
acceleration, or deceleration, Lowell?" 

(c) "VJhat do you think about Bobby's method of solving the prob- 
lem, Marilyn?" 

(d) "How many centiliters are in a mip.iliter, Scotti?" 

(e) "How did you know that was going' to bappen, Tracy?" 

(f) "Does everyone understand what Cathy is aaying?" 

(g) "Do you ^gree with that,* Paula" 

(h) "VThy do you agree with that, Paula?" 

(i) "John, what's happening now? What do you see?" 

(j) "Is there anything wrong with that. last row I Just^yrote on 
- the board? Is there any data that looks as if it doesn't fit 
in with the rest of it? 

After you have coded these questions as either 3B or "Other," on a 
separate sheet of paper, turn to the next page please. 



6G 



212 

frame 6l ^ 

-61- • . " 

(a) 3B — Student aalted to' give reaQonc for ancwer or ctatement. 

(b) 3B — otudent io being aoked to interpret a graph do thio io 
probably 3B. If the teacher hao previously aoked a number of' 
2A quGDtiono, one ni-^ght cuopect that thio ia a recognition type 

of queation where they nee the graph shape and automatically r . * 
asaocla'fee the chape with a learned reoponoe ouch ao 
"deceleration." * ' - " 

(c) Other — This io an evaluation queotion': 5B. 

(d) Other ~ Thin io a reaooning vrith a learned oequence: 3A* 

(e) 3B ~ Student aoked^ to give reaoono for believing previous 
aooertion. 

(f) Other 1 ' ( ' 

(g) Other — Coding depends oh- contex^ If otudent io 'evaluating 
anower to a cognitive-memory (2 A^B) or convergent-production 
queotion (3 A,B,C) thio would be given the oame code. Otherwise, 
it would be a 5A if both agree and dioagree optiono are equally 
acceptable ao a response, ^ ' . . 

(h) 3B - ' 

(i) Other — ?B: student being asked to dec=cribe what he sees, 
(j) 3B — they are being asked to infer frdCm the data which 

individual datum doesn't, look like the rest of the data. 

If you missed more than two questiojin, discard the piece of paper 
on which you wrote your answers and turn towage ^^8. 
If you missed two or fewer, turn to page 62, 

<5 
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Below in a transcript of a phynical opience poot-lab diocuocion. 
Pleace code the queotionc preceded by a lower c^oe letter in paren- 
theoeo aa either 1, 2k ^ 2B, SA^ 3B, or "other," Fee^l free to attempt 
oeparating the "other" queotiono into the proper categories an well, 
since these will bo listed and discussed. Concentrate on the codes 
you have already worked with in this prof^rarn, however. Please write 
your coding on a separate sheet of paper. ^ , 

T: '(a) Keelie, what do you see about these eight sets of data that 

looks the S0pe? ^^jj^ , 
Gl: They all use numbers? ^ / 

T: O.K. That's one similarity but that's not exactly < what I had in 

mind. (b) Marcie, do you see anything about those sets of data 

that looks the same besides the fact that they all use numbqrs? 
S2: (LONG PAUSE) Gosh that's a hard questions^. Edelmeier. (c) 

V/ouldn't it b(? easier to see if we grapjied thom so we could kin^ 

of look at them ao pictures? You Imow, like we did with the 

other experiment, with colored chalk and stu 
T: That's an excellent idea but we don't have enough board space to 

graph all of them. (d) How ooiild we solve that technical 

problem, Jackie? ^ 
S3: Put 'em all on one graph but use the colored chalk so that each 

one is a different color Jusi/ like you did in (?lass Monday. 
T: Great idea! (PAUSE) (e) Andy, what should .we have along the 

X-axis? " * 

Sli: Time? 

T: Andy says to put time on thi?' X-axis . (f) T.n ^hat O.K. with 

everybody? (SHORT PAUSE) li-I-M-E (writing on board) (g) Rosy, 
how many units do we need? 

S5: (Counts out loud from one to twenty) V/e made twenty measurements 
so we need twenty units, 

PLEASE TURN TO THE NEXT PAGE 
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T: Right! You're getting to "be a real expert fc.t setting up graphs, 
Rosy. (PAU^E) Uh, . .(h) James, how big ^ should' those units "be? 

S6: Er uh lemme see. . .We took the temperature every 30 seconds so 
every time unit should be 30 seconds, bigger than the 'time unit 
/ before it. ' • , . 

T; Right! Right! That's real good, James. (i) Darcell, what a^^ 
we going to put^ along the Y-axis? 

ST: Temperature, 'v * 

T: O.K., temperature. (j) Betsy, do you agree with that? 
S&: Yessir, that's right. 
T: (k) Why dp you think that's right? 

^f8: * Because- temperature is the 6nly other thing ve'^^^asuredl 
T: O.K., just checking. That's real good Darcell.'. .NoWy>^I want 

each group to send one person to the board to graph that groups 
data. Be sure to use a different color of chalk 'from the other 
group. ' ' , 

(General confusion I'eighs fot about ten minutes) 

T: All right Calm Down !!!. ^ . .T>anny, you and Imelda turn around an^ 
pay attention. Judy, put your makeup back in your purse and pay 
attention to the board. Jackson sit down and be quiet. (SHORT 
PAUSE K 0 . K . , tffat ' s better Nc|/ Marc ie ; you suggesi^d graphing 
the data. (l) Can you -see anytping about all ihose sets of 
data that look alike? | 

S2: (Very long pause) Well, . • .they're all shaped kinda alike. . 

(Another VERY LCfiNG PAUSE) I meaft the -graphs are. . . uh, thel ^ 
temperatures are. . . tiOU know, the temperatures kind of go down 
real fast ^ at fir^i, then they go. down real slow,ythen they all 
kind of gq down real fast again, . .well, not real fast, but 

PLEASE 'TURN TO THE NEXT* PAGE ^ ' , 

^ • ^ 
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frame 
-61*- 



faster than when they were going down rear slow (another LONG, 
pause). That's the only thing 1^ can see. - ' ' 

T: (m) Ruben, do you see another way the sets of data look all 

alike? . ^ . ' ^ >^ 

^S9: Well, not' all of 'em, but h of Vem* are real close together/ 
you know?. . .1 mean, 'they start- to go down real slow a whole 
lot sooner than the other four . And the other f ovir are real 
close together too. I mean. . .well, they all start to ^ down 
real slow at)Out the same time too. (LONG PAUSE) Do you want 
something else? (PAUSE) Well. . .uh. . .(D.K., the two groups 
start to go, down real slow at different temperatures. 

T: Hey-, that's pretty sharp. I 'wasn't even ready to 'ask that 

question. (n) Anne, why" do you support fovir sets of data are 
ve'ry. similar to each other but not to the '^ther fovir sets? 

SIO:' (pause) Uh.(LONG PAUSE) Well, uh (Another LONG "tAUSE) Some of 
us used moth flakes and the rest pf us used moth balls and 
we had to .really grind out mothballs up while the people who 
had mofh flakes Just kinda povired 'em right into the test tube. 
You know, guat.like they were, without grinding them up. (LONG 
PAUSE') I mean, it's probably because some of us ground ours .up 
real real good in the mortar and pestle and the others kind of 
used theirs real lumpy. You know? 

T: That's a real good explanation;- (o) How could you tell whether 
^ or not her explanation is right, Larry? 

PLEASE TURN TO PAGE 3 OF THE KEY BOOKLET 
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The next level of* convergent-production qut ^xons are coded as 3C, 
These are the questions which require' a student to produce a best or 
right answer to a problem or question, the right ness or bestness of 
which can be judged by objective criteria which have been previously • 
established by someone other than the student who is answering the 
question. Again, the answers to questions of this type are logical 
necessities (or very high probabilities) • rather than logical possibi- 
lities. Unlike the previous categories, however, the student has not 
learned the bestr or even a good way to go about producing the. answer; 
the student has not learned a series of steps, formula, classifica- 
tion ^/G tern, or whateyer which is associated with getting a right 
answer co this kind of . question. The stu^derit h^to produce 'the 
method' for getting to the r^ght answer as well as the right answer 
itself. 

Ihcluded in 3C category are many ^ of the quest^ioifB which would be 
classified as application and analysis questions in Bloom's 
TAXONOMY (other application questions might also be coded as 3A or 
3B) . Questions asking students to identify tjieir underlying assump- 
tions are included in category 3C (This is' ^ot the same as asking 
them them to give their reasons for presenting a certain answer or 
statement. This is asking t% stuglent to identify the assumptions, 
often unidentif;L^d, \5qiich must be true if his <?r her reasons, pre- 
dictions, etc., really^ apply** to the "^situa^ion,." One common assiunption 
which underlies science is that universe can be understood by 
humans. Another is that events can be predicted within certain prob- 
ability ranges. if one' knows what the relevant antecedent events are. 
Both of. these are probably true with a capital T, but they remtin 
unproven assxamptions^ ) \ . . 

, ' ■ PLEASE TURN TO PAGE 66 ^ ' " . 
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frame 66 
-66- 

To this point in the program, the examt)le questionc have. been derived 
from audiotapes of lieachers conducting real science lessons in the 
public schools. This policy will be continued but this will insure 
that the section on 3C questions 'is quite short. The reason for this 
is because secondary science teachers as a group Just don't ask very 
many 3C questions while they are conducting a lesson. Questioris of 
this nature may appear on exams and quizzes but they do not appear 
very often during classroom' interaction of any sort. Perhaps their 
phrasing is too difficult for spontaneous occurence in classroom 
discQurse. ^If this is the case, teachers should probably plan to use 
them* ahead of time if they feel that this type of question needs to 
be asked during some lesson which involves using questions. Perhaps^ 
many secondary science teachers feel t*hat theit' students would not , 
be able to answer this type of question and do not ask this type of 
question because they wish to protect their students from almost 
certain failure. If this is the case, perhaps they should at least 
ask tl^eir students to occasionally identify their assumptions which 
underlie the reasons behind tlheir answers. The ability to do this 
(identify underlying assumptions) might transfer to other situati6ns 
and be quite useful to the students in their life away from sphool 
and in their life in other classes. This is merely the opinion of 
the 'writer, Hjjiowever. End sermon, ^ Restart Program, Please turn to 
page 67. 
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frame 6? 
-67- 



Below are five questions. Please read them* 'and code them as 1, 2A, 
2B, 3A, 3B, 3C5 and Other. Feel free to code the "other" questions 
as Ua, Ub, kC\ and 5B since these codes will be identified and dis- 
cussed as well as the first 6. Please concentrate on the first six 
categories, however. 

(a) "V/ho can tell me what it'll probably do?" 

(b) "You said the temperature would remain the same if ^ kept 
boiling it, and I*m interested in why you said that. VThat 
do you have to assume to say that, Roger?" 

(c) "Do ypu think abstinence is a good method of birth control, 
Sandra?" 

(d) "VThy not?^ 

(e) "O.K., imagine that you are a meteorologist an(^j|that you're 
giving a talk to some 6th graders about what yo^do for a 
living. V/hat are some of the things you might tell them, 

" Roxanne?" 

After coding these question's on a separate sheet of paper, turn to 
page 68. 
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' frame 68 
-68- 

(a) 1 — The teacher ic not actually- asking Gomeone to predict. 
He or Dhe io merely askinf^ for a volunteer. If a volunteer 
give a prediction, Dcrore as ^iB, 

(b) 3C — Identification of underlying asstiraptiono in Being 
requested, 

(c) Other — ThiG is asking the ptudent for an evaluation: 5B, 
(,d) 3B — student is being askeid for reasons behind a previous 

•assertion (the assumptions underlie the reasons which in turn 
underlie the initial statement of an answer, opinion^ etc.) 
te) Other — Tfiere are many acceptable ansvrers to this question 
so it can be consid^ered a UA, 



PLEASE TURN TO THE NEXT PAGE 



frame 69 
-69- . ■ 

Below are five questions. Two of them are 3C questions. Identify 
which ones these are, 

(a) "Which of these plants — the one's described by Sandra, Bobby, 
and Miguel — would be best able to survive under the condi- 
tions I/ve listed over here, Martin? 
' (b) "VHiy do you think the period of the penduliom stayed the saine 

even though you lifted the bob higher before you let it go, Judy?" 

(c) "0,K,, Sandra said the^period of the penduliora would be shorter 
if the bob were heavier. How could we test to see if she's 
right, Micky?" ' , 

(d) "Allright, Micky said to add another washer to the string. Is 
that a good way to test Sandra's hypothesis, Harold?" 

(e) Now that we have all the st^e^s to the experiment written on the 
board, I'm gonna ask someone whether or not performing the experi- 
ment as it is now vrritten up there will really answer the ques- 
tion, or whether there's something ya'll are still leaving out. 
l-Thichej^er one you decide;. I'm going to want you to tell me why 
you ^^ided that way, I'll give you a few seconds to think about 
it before I select my victim (LONG PAUSE) Anabella?" 

PLEASE TUI^N TO PAGE 70 \ 
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' frame TO 

• ' -70- 

The 3C quectiono are (a) and (e). If you did not identify thece 
queotionc as 3C , or if you identified one of the other queotiono 
aG 3C J please "turn to page 71. 

If you correctly separated the^^ questions from those which were 
not 3C, please turn to page 7^- 



\ 



frame 71 • 
-Tl- . ^ . 

(a) This 3€ question- is one which might be classified as 'an -vllM^ 
MALYTICAL question using Bloom's system. The wording implies 

that one of the plants is, in fact, better able to survive under 
the listed conditions. In order to produce the right answer 
(i.e;, pick out which plant would survive) the student must 
comxmre a variety of each plant's characteristics with environs- 
mental demands which are pertinent, ^ <> 

(b) Coding this type of question depends on context, but questions 
asking for hypothesis formation are generally coded Uc , If the 
hypothesis has been previously studied, of- course, the question 
would be coded 2A. 

(c) There are usually several ^equally acceptable vmys to test any 
hypothesis or prediction. For that reason, experimental design 
questions are usually eroded kB, 

(d) This simple agree/disagree evaluation should be coded 5A (stu- 
dent says "yes, it is a good design" opr "no, it's not a good 
design" ) 

(e) This is an analysis' question too. In this case, the student 
\Tho answers the question correctly must have examined tl^e 
question, analyzed the experiment design to determine if all 
factors are included and controlled, and then examined vrhether 
or not the observing technique is sufficiently sensitive to 
answer the question. 



PLEASE TURN TO PAGE 65 
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frame 72 

-72- f 

Below Ig a tranccript of a lescon on gao lavs taught to a 9th grade' 
physical science clasSr... Please code the questions preceded by lower 
case letters in parentheses as 1, 2A, 2B, 3A, 3B, 3C, and "other." 
If you wish to code the "other" questions aq, I4A, kB, UC, 5A, and 
5B, please^ do sq since thesef codes will be listed and discussed as 
usual. Please remember that, when using this category system, you 
should attend only to the kinds of questions the teacher is asking. 
Wot to other things that the teacher and/or students are doing. 

T: Class, today we're going to talk about gas laws. (a) Can any- 
one tell me what a gas is? iMUCH NOISE AND CONFUSION) (b) 
Ardella, what's a gas? , ? 

SI: Yes ma'am. A gas is a state of matter that doesn't have no 
shape or volhame. 

T: That's about a good a definition as anyone could think of, I 

believe. (c) Can anyone give me an example of a gas, Robert? 
S2: Fire Chief and Qblftane. 

T: Uh. . .That's not the kind of gas I'm talking about, Robert. 

V/e're talking about the states of matter like solids, liquids, 
and gases. (d)-^V7hat state of matter is a gasoline like 
Gulftane, , Robert? 

S2: I dunno. Depen's on how hot it is. 

T: (e) SuE>an, what stal^e of matter is gasoline? 

S3: Isn't it a liquid? \ 

S2: It ain't no liquid in the cylinder of my brother's short!!! 

T: (f) Robert, wouJ.d you please refrain from shouting out like that? 

O.K. , nox^r, I have a. little apparatus set up here so we can 

experiment with gas laws. 

€ 

PLEASE TURN TO THE NEXT PAGE 
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J 



-73- 



T: '(s) Johnny Lee, vrhat'o thic5 thing right here? 

SU: That* 3/ a roun' "bottom flack, 

T: Right, Good (h) Mary, what'o thin? 

S5: Rubber stopper. " . ^ 

T: (i)=. O.K. 5 how many holes are in it? 

'35: Mug' be three clause I can see three things sticking up out of it. ^ 
T: (j) Hovf do you ktiow tWt the number of things that are sticking 

up are the same as the number of holes? 
S5: Cause I can see the bottom of it from where I'm setting and there 

ain't but three holes in the bottom, 
T: O.K., Good. (k) Willie Jones, what are these three things 

sticking up? 

S6: V7ell, one of 'em's a piece of .glass with a balloon tied to it 

and one of em's a pencil^ and I don't know what the other one is. 

S2: (LOUD VmiSPER) Tha's a stopcock, fool. Don't you know nothin'? 

T: Robert! (PAUSE) O.KL That's a stopcock. Now, I'm going to 
blow into the stopcock, (l) Vftii^i's going to happen to the 
balloon, David? 

S7: It's gonna blow up. ^ * 

T: O.K.^ David said that the balloon was going to blow up. (m).Do 

all of you agree with that prediction? 
S2: It ain't gonna do nothin'. 

T: You don't think it will blow up :Robert? (n) VJhy MOT? 

S2: Cause the .stopcock's turned the wrong vmy. Anybody can see that. 

You Just gonna get red in the face blowin' on it like it is.' 
T: You're right. I had it turned the wong way. Thanks for warning 

me. (o) O.K., if I turn it this way, will the balloon blow up 

when I bloT^r on it? 



PLEASE TURN TO THE NEXT PAGE 
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frame Ik 

S2: Yeah. 

(PAUSE: Teacher is blowing up the balloon. Converoation of studenta 
chattering, in background need not be tranocribed for the purpooeo of 
thio module. ) 

T: (p) VThy did the balloon blow up, DcLvid? 

ST: Because you blew your breath in it. V 

T: (q)- VThy did it stay blown up, VJillie Jefferoon? 

VjB: Cause you turned that thing and wouldn't let the air out. 

T: (r) J)o you think the balloon wi^:! go back down if I opened the 

s topcock? 
S8: uVhuh. 

T: Let's try it. (PAUSE) You were right. That's good, V/illie. 

Allright, I'm going to blow it up again and then we'll do another 
experiment. (LONG PAUSE, again with much non^pertinent back- 
aground chatter.) ^ . 

T: O.K. , be quiet and listen everybody, so you'll know what we're 

doing.. Patriae, hush! Somt You, too. (PAUSE) I've got a pan 
of ice water here. (s) VJhat's going to happen if I put this 
ice" vmter around the round bottom flask, Cornelius? 

G9: Nothin', it's just gonna get cold. 

T: O.K. (V/rites on board). (t) Arthur, what do you think is going 
to happen to the balloon when I put the ice water around the 
bottom of the flask? 

SIO: I dunno. 

T: Robert? 

32: That balloon in gonna get bigger. 

T: ' (Writing on board) Robert' says it will get bigger. (u) do 
you think it will -get bigger, Robert? 

PLEASE TURN TO THE NEXT EXCITING PAGE 
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frame 75 
-75- 



S2: I don't THINK it's gonna get bigger, , I ICIJQW it'o gonna get 

bigger. ( LONG PAUSE) When I push air into a ouiall cpace like 
when I push down on my bicycle pump and hold tWe end closed^ real, 
tight the pump gets real hot. Since it getn hot when you push 
it into a small space, it'll get bigger when you get cold. 

T: O.K., well, I'll Juct wite the other possibility down too. 

(V/rites on board), NoWj let's vote. How many think the balloon 
will get smaller? (PAUSE) Nobody? 0,K, how many of you think it 
will stay the some? (PAUSE) ' Cornelius , did you change your mind? 
Allright, how many of you think Robert is right when he says 
it'll get bigger? (PAUSE) V/ell Robert, everyone thinks that 
you're right. Let's try it (LONG PAUSE) (v) Hmmram, What's 
happening, Robert? 

S2: It's gettin' smaller, 

T: Well, you said it would get higgler, but it got smaller instead, 
(w) V/hy did that happen? Think back through your reasons and 
figure out what's wron,? with them. V/here did you miss in your 
thinking? Why did you think pushing on a bicycle pump was the 
same thing? 

After you have coded these questions on a separate sheet of papiei 
turn to page of the key booklet. 
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/ " frame 76 ~ 

-76- 

The next category of quec^ionc are divergent-production queotionij. 
One might say that thia category of question invites the production 
of logical pooGibilitieo for anovero rather than the production of 
oncwerD which are logical nececoitiec (QueGtionn vhich require ansvrero 
which are logical neeesoities would be claGoified as convergent- 
production oi:* pouGibly ao cognitive-memory). Like the convergent- 
production quentionr^, there are three differ§?nt typeri of divergent- 
production quoGtionn which ore coded, ctrangely enough, i^A, UB, and 
he. Below are linted several qti'SotionG, nome of which ohould be 
coded ao Ua. Pleace try to identify the Ua queotion. 

(a) '*V7hat would happen if they' continued to move further and further 
apart. Herb?" 

(b) "V/hat in one example of a gas, Robert Earl?" 

(c) "VJhy do you suppose the tall^er candle went out firsts Ceoille?" 

(d) "VJhat are some of the things that you can use to tell v/hether 
or not something is living or non-living, Rodney?". 

(e) "Alviri, pl'ease tell us what temperature yoa, got v/hen you dis- 
solved the alka-seltzer in the v/ater." 

After identifying vfhich of these questions are Ua^ please turn to the 
next page. 



frame 77 
-77- 

Questions (a) and (d) are hA category questions. 

If you missed either one of these, or if you coded another question 
as Ua also, turn to the next page. If you correctly separated these 
from the non-liA questions, skip to page 79- * 

If . 
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f rojne -78 

Below ore lioted oorae quectionc. Read them and write dovm the 
characterictrcD you think they have in coinmon which allpwa them to 
be placed in the oorae category. \ 

(a) "name one kind of oedimentary rock Alvln? 

(b) "Vniat kindo of thingc would you like to Dtudy in ocience 
thiG^ vreek, Debbie?" 

(c) "Comille, could you tell uo one example of friction from 
everyday life?" 

(d) "V/hat kind of plants would you like to put in the terrarium, 
Joe?" 

Pleaoe wite the common character iGtic(a|) on a separate sheet of 
paper . 

THEN ^ TURN TO THI? NEXT PACpi PLMSE 
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frame 79 
. -79- ^ 

y 

hh queotiono are^elth'er completely opon or may bo annwared with a 
wide ran^e of factually correct anowern. The ntudent may uce exten- 
ded reasoning to produce an ancwol' to a kh queotion, but extended 
reasoning in not aboolytely nececcary for producing an acceptable 
an:>wer. Students might even.be able to draw on j^reviouoly learned 
information t/> annwer ouch a quo:;tion rjo long an it Id poncible for 
neveral student:? to answer the question with a different anr^-zer and 
^all of them bo "right." 

Below are f ive. queotiono . Identify thone that ohould got be coded 
ao Ua, 

(a) "V/here could you find .warm water in the ocean, Jerome?" 

-(b) "O.K., Mr. V/right, would you give uc an exrimple of pollution?" 

(c) "What in one unit of measure in the metric system, Otanley?" 

(d) "V/hat are some of the things that you might find in oceans, 
Rafaella?" 

(e) "Name 'an economically valuable mineral, Cleveland?" 

After you have identified those questions which are not UA, pleane 
turn to .the next page. 



frfime 8o 
-80- 

All five of these questions should be coded as Ua. All of th(?rfl are 
open questions which have many acceptable answers and do not require 
extended reasoning to produce an answer. Even a quo^ition such as 
"V/hat is one unit of measure in the metric systc^m, Gtanely?" vrhich can 
be answered by drawing on previously learned . information is coded' as 
Ua because there are many possible correct answerii to the question. 
(No matter what St^inley replies, the teacher can direct the question 
to another studc^nt such that: "V/hat ' s** another^ unit of measure in the 
metric system?" and the second student to answer the question can give 
a different equally correct ans^^rer). If you coded one or more of 'these* 
as Not-lA, write do\m in your o\m words the charactf^ristics of ^^A 
questions and then turn to page 8l. - ^ 



82 



,If ypu, decided correctly that all the questions were UA, pldase ^urn 
to page "82. . . . ^ 



frame 8l 
• -81- 

The Uk qu^tions are simple divergent questions \7hich have many accept- 
a"t>le* answers . Extended reasoning is not. required for producing 
answers to UA questions but may be usedQif the student chooses. . 
These questions can be completely open such as "JClizabeth, what are 
some ways we might use this beaker?" or they may require a factual 
type of answer with many possible correct apswers such as "What's one 
exaihple of something that is not a metal , Luis?" Answer's to UA ^ 
que$'tions do not require extendedf^reasoning to produce and there are 
many possible answers which are equally acceptable as responses to- all^ 
h^k questions . - ' . 

If, your description of the characteristics of "UA 'questions was similar- 
to the above, please tiirn to page &3. If your descr^^ptlon. was very 
much different from the above, please tarn to .page:J[.6. 
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-frame 82 
-82- 

UA questions are fairly sijuple, and they allow a very vide range of 
responses which can legitimately be considered acceptable, rights 
correct, or O.K.; a type of Ua question which is common to many 
science lessons is asking a student to name one example of a class 
of some specific" group^Uf organisms, chemicals, rocks, etc. Other 
types of Ua questions which commonly occur in science lessons are 
the type of question which teachers ask when they ask a student to 
propose some potential uses for a mineral, technique, piece of 
apparatus, new tejQhnolo^, and so fortjh. These are not the only 
Ua qued'tions which- can fee asked in relation to teaching science but 
they are very common kinds of UA Science questions. 

V7rite 3 jiA questions whioh you could use in teaching your class. 
After yorM^ave written these questions, check them against the 
description above. If you feel your questions match that descrip^ 
tion, turn to page 8U. - 

^ ■ ■ ' • ■ ■ V 



frame 83 - ' ^o:^, * • ^ 

-83- ^ ^ h 

You will no\j recode ^ lesson transcript ~ which you coded earlier. I'his 
time', ad(i Ua to the other categories which y'cm are designating (l, 2A^^ 
2B, 3A, 3B, 3C). Also use the '^Other" category for questions which 
fall into Categories you haven't yet studied ("Oth^r" includes only 
four categories now; youlre nearly through with the written par tt. of 
this module). \ ^ " ^ ^ 

Be sure'thut you follow the directions in the key bOokle^b^^pertaining 
to recoding tfe transcript which begins on page Uo. The -airections 
following recoding are quite different ^rom. those which follow the 
initial coding. ^. 

PLEASE TURN TO THE TRANSCRIPT BEGINNING ON PAGE Uo."" 
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i '■ frame 81^ ~ ^ ~ 

The next category, Ub, includes questions which require some extended 
reasoning to produce one of the many possible accepttible ansvrers. 
Examples of types of UB questions include: (i) questions which ask 
'students to compare, contrast, or classify using ^criteria for classi- 
fication and comparison which they themselves generate ;( ii ) questions 
which ask students to predict when they lac'k sufficient' data to 
insure success or make success highly probably; (iii) questions which' 
ask students to propose an experiment or a step in an experiment for 
ansv^ering a previously asked question (Note: if the teacher asks a 
studenJt to propose a step for an experiment the student is expected 
to have read, outlined a procedure for, etc., the questions would«be 
a 2A, NOT ^^B; ^iB questions are those which ask the student to design 
an experiment rather than use an experiment designed by someone else)* 

The -key to each of these is that several different equally acceptable 
ways to answer exist even though some 'fairly stringent logical cri-/ 
teria may be applied in Judging the answer. In context, the pre- 
diction from, insufficient data is often used -as a. strategy to buiid 
interest in the outcome of a particular exercise and might even be 
used with experimental design questions during the same pre-lab 
period'. . Classification questions which can be coded as hB are often 
used prior to the introduction of a more scholarly system ("Scholarly'^ 
means "in the textbook" usually), again to generate interest and 
develop process skills. * . ^ 

< PLEASE TURN TO THE NEXT PAGE 
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fraJBjs 85 
-85-' 

Below is a short transcript of an 8th grade earth science class. 
Please read it and, where indicated, wite down a hB_ question which 
you would use in this situation. 

T: Joe's ready to shov us hisproject, so ya' 11 /button up. . .Joe? . 

SI: This is a sand-squeeze box that shovfs how^auiting works. All 

there is to it is a box vfith a glass front and^a truck ^ack with 
a piece of wood thd sis^ 'of the interior Of^the^ox bolted to 
it. The jack and the piece of wood can act like a piston. 

S2: V/hat do you do with it? . , ^ 

Gl: V/ell, you put in several layers of sand so that you can see the 
layers. Then you can crank the jack up to see what happens 
to the layeXs if you^push on them. . .Or you can *crank the jadt 
down to see what happens to the^ layers, when you release the 
pressure 'ghat's holding them where they are. 

S2: V/hat keeps the glass from breaking if you ^c rank the jack up 
real high? ' • j " 

SI: It's safety glasa. It won 't^ break. 

S2: Oh, O.K. ' ^ 

S3: What's faulting? 

3h: How do you tell the layers apart if all you put in there is . 
sand? 

SI: You put cement or plaster of paris on top of each one of the 
layers so that it makes a gi?ey line %l^^t you can see b^t'vreen 
each one of the layers. 

S3:.' What's faulting, Joe? 

SI:* It's. . .Uh. . .1 don't think I can explain that. Mr. Delarose, 

could you ^ell 'em what faulting is? 
T:' Well, WQ haven't studied that unit y'et and it's not really part 

of this unit , 

PLEASE TURN. TO THE NEXT PAGE 
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frame 86 ^ 
-86- 

T: (continued) but I gue^G thereto no time like the present oince 
you brought in Guch a neat project, Joe. . -Ronnie, you and 
Steve take those buckets und go outside to the candpile to get 
enough sand to fill this box between a half and two-thirdc full. 
Rosie, you go into the storeroom and look on that wall next to 
Mis Morgan's room on the third shelf from the bottom and bring 
that sack of plaster* of par is that's already been opened and put 
in a plastic break bag- , 
(LONG BREAK while they set up the sand-sque|eze « box - Finally, it is 
set up T'^'ith the strata clearly defined and visible from the 'back of 
the room and the jack in place ready to apply pressure either toward 
or away from the layers of sand- Pretend you are the teacher.) 



T: 



V/rite do^m a question to use at the point in the lesson indicated 

by the blank space above- After witing do™ the question, turn to 

>'the next page and compare your question to options that might be 

available- . - - 

\ ; 

1^ ^ ^ " 
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frame 8? 
-87- 

A common type of kB question vritten by teachers \rho have already 
c-bf^pleted this module is the, type vhich asks for a prediction from 
insufficient data — i.e., most teacher-s vould ask a student to pre-, 
diet what VilL happen , even though they haven't studied faulting yet. 
One such question submitted by someone who has already worked through 
the module was : 

"V/hat*Q going to happen to those layers when I put pressure 
' ' on them with 'the Jack, Stanley?" 

' The teacher from- whose lesson this transcript is derived asked a 
different kind of UB question: 

"Can you think of another way we might set this up so that we 
could tell the ^difference between the layers, Caraille?" 

Botl^ alterriatives are acceptable; they both require some reasoning 
to produce good answers, but many answers which can be considered 
good are possible. I^oonctwho has vrorked through the module so. far 
has witten a classification or comparison type of hB question. If 
yours was like this, please write it below. Then turn to the next 
page. ' ' - ^ 
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frame 88 
-88- 

continue with the tranocript as on page 86, 

T: Can you think of another way we might have Get thio up 'go wg 
could tell the layers apart without ucing plaster of paric, 
Cajnille? 

SU: (LONG PAUSE) You could upe different colore of cand like the 
□tuff they Bell in the craft Ghop across the street at Dobie 
Center. . 

S5: That'd be too expensive, Camillel Look how much sand it takes 
to fill it u£l " - 

Sh: 4-/e could dig up some dirt and use it for every other layer. 
That way every 6ther layer yould be a different color. Does 
it have to be sand, Joe^'^or can we use dirt? 

SI: I 'guess it would work with dirt if the dirt were dry, but I'm 
not sure. • 

B6:^ Yeah. V/e could get some dirt from Bert's Dirts out by my 
house, A'Jhy don't we go on a field trip to Bert's dirts, 
Mr, Delarosa? " 

T: V/ell, if you liv^ right out there, why don'Kvou Just stop by 

after school, this afternoon and pick some up? If you do, vre'll 
try it tomorrovK . .Now that ims a pretty good idea and I'd 
like to try it out of eomeorte'll bring in some dirt to make 
layers with. Right now, though/ we 've already got it set up 
another way. ^ . 



V/rite do\m another Ub question which you might use at this point in 
the lesson. Then turn to the next page. 
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Again, the'mont common type of question proposed har> been to ask for 
a prediction, of vfhat vfill happen. Thld is an excellent type of 
question, especially if the teacher plans to elicit predictions from 
many different students to* get a wide variety of predictions. 

Again, noone v/ho has v/orked through the module to date has proposed 

a classification or comparison type of question. If you v/rote such 

a question, please vrrite it in the space belov; so ire can use it 
vfhert v;e revise the module. 



The teacher vho actually taught this lesson asked ano»ther experi- 
mental design type of question. 

Please turn to the next pa^:;e and continue v/ith the transcript. 

U ^ [ 
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T: ' O.K.', what do you want Joe to do, put prencure on the nand or 

relieve'the precnure? VThich way should he crank the Jack? 
(GENERAL PANDET^ONIUM) 

T: Let's vote. Everybody who wants to put more prencure on the nand, 
raise your hands. (COUNTING) V7ell, it looks like they want you 
to increase the .pressure on the sand, Joe. I don't think there 
is any need to ask for a vote on the other alternative. V/AITI 
Not yet, Laura, what' do you, think will happen when he increases 
the pressure on the sand layers? (THE TE/VCHLT^ VHIO ACTUALLY TAUGHT 
THIS LESGON FINALLY GET AROUND TO ASKING A QUESTION LIIOC THE ONE 
THAT HAS BEEN MOST POPULAR WITH TEACHERS mO IIAVE WORKED THI^OUGH 
THE MODULE) • v 

S3: Well (LONG PAUSE) It's going to Just kinda squunch up together { 
(LONG PAUSE) I mean the layers are gonna get thicker than they 
are now. (PAUSE) Except for that, nothing is going to happen 
to them. 

T: Fred? 

ST: VJell, I think she's right, except the layers are goinfj to be a 
lot thicker at the end closest to the Jack -than they will be 
at the other end. (PAUSE) Do you wa,nt anything else? 

T: That's O.K. . (V/RITING ON BOARD) So you and Laura say that it's 
gonna look like this after we put more pressure on th^ layers? 

PLEASE TURN TO THE NEXT PAGE 
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GY: Make the layers thicker than that at thf? end by the Jack and 

have them kind of curving up too. . .Ho, curvin/3 Mp tovmrd the 
Jack at that end. 

T: (DMV/ING ON BOARD) Like thia? 

HT: Yeah. \ 



T: Id that allrif?;ht with you Laura? Doen that Iftok like vrhat you 

vi^re trying to describe? ""^""^ 
G3: V/elllllll. . .1 don't think it vrill curve up like that but the 

rest of it is O.K. 



V/hat kind of hB question could you 'as the teacher ask at this point 
that could keep the lesson movinf; in 'the direction you wish it to r.o? 
Please turn to the next page to check your question with some of the 
available options. 



Go far, every teacher who has worked throtigh the module prior to this 
edition has written a question designed to elicit another prediction 
G^ich as: ^ . " 

*'V7hat do you think will happen vfhen we increase the pressure 

on the layers, Robert?" 

The teacher vfho actually taught this lesson when it vms recorded did 
not U0e a hh question at all, although he easil/ could have. He used 
a 3B question. 

"Fred, can you convince her that you are right? VJhy do you 
think it's going to curve up like that? 

This is a 3B question, because the student is being asked to list the 
reasons for making the prediction he made. 




frame 92 



please turn to the next page 
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After vrriting and diGCUDsing a large niim"ber of J*B quectiono, you ohould 
be ^le to identify them when they occur. You are novf ready to examine 
category Uc , In the opinion of Dome teacherc and other profescional 
educators, hc quentionr. are what ocience e^ducation io all about. In- 
cluded in thio category are those quectionc vfhich vxould be claoGified 
an .nYNTHEDI[3 by oomeone ucing Bloom nyotem. Also included are 
questions vfhich ask students to propose a hypothesis whicft vrill account 
for certain observations, data, etc. (this is a type of synthesis 
quefJtion). , 

V/hen coding kC questions, context is especially important. The 
earlier questions asked by the teacher and the words and tone of 
voice thQ responding student uses are both important conteict cues 
for deciding v/hether or not the students have actually read about or 
been told about the hypothesis V^hey are proposing. If they have 
studied the hypothesl^previou^ly ? a question asking for the hypo- 
thesis would be coded p a 2A. The level of the students must also 
be considered, regardless of what has been studied (or rather, not 
studied) in a particui/ar class. For exainple, many questions that 
would definitely be hjc for 9th grade physical science stud^^nts would 
be ^A for college-bound seniors vfho are taking physics as an elf»otive, 
no matter what the teacher ^ has .of ficiai;iy dovered during the course 
prior to asking the question. 

>^ , 

Tho moot common type Uc quontlon heard in :;cit?nce clause;; i;-, the 
type anr.ociatod with asking for hypothenia formation. 

/ PLEASE TURN TO THE NEXT PAGE 
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Below are n<?veral examples of hc QXxowKfgtb which, like other diver- 
ge»ri^t-production queotiona, allovf a vide " vari^ety of acceptable aricwers. 

Qi) Robert, I vrant you to go to board and, using nothing but 

inorganic chemicals to start with, make up a route to synthe- 
size .aspirin. The structure for aspirin is vrritten over on the 
side board if you don't remember it. 

(b) There are huge coal deposits near the North Pole in th(^ Arctic 
Circle. Considering vrhat you knovr about how coal vras formed 
and both the temperature and the incident light at the-^sWorth 

.Pole, hov; can you explain the presence of coal deposits up 
there, Geneva? 

(c) The vmter will hold only Just so much salt and then it Just won't 
hold any more. The extra salt Just sink^3 to the bottom and 

vnll not dissodve. V/hat kind of picture or analogy can you 
invent to shovf hovf vmter and salt act to act. like that? VTliat 
can you think of .that you can see and fool arooind with that 
might exhibit similar properties so that you could say the 
water and salt are acting "as if" they -vrere like that? 

(d) "V/hy do you suppose the vmrm vmter stayed on the top instead 
of sinking to he bottom, Cynthia? 

after carefully reading all the Uc questions above, 
PLriAGE ITON TO PAGE 95 
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Vleav.e cate^o^'i^''^' "t-he queptionn bolow ar> 1, PA, 2Bj 3A, 3B, Ml ^ hA^ 
UB, and Uc. Cincf? the only other major cato^^ory remaiuin^^ for you 
to learn lr> th^ Kvaluatlon category, code the "other" with' a 5. If 
you wiTih to dictin^uiGh betv/een 5A and 5B, f^el fret? to do uo. 
V/rite your coden on a separate r.heet of paper pleane. 

(a) "V/oaldn°*t you have the name kinder of eurrfniti; if you had hot 
and cold water in the ocean?" 

(b) "Marvin Jui:t naid that the dennec.t water in the oeeanr. comf^i: 
from -the PJorth and Couth poler, . How could we find out if thir. 

^ i:; true?" 
(c') "V/hat ir. r.alinity, Nancy?" 

(d) "That thine I have projected on the vrall reprenentn a photograph 
of L^.ome fonnil footprints that were found by nome geologir>t:i in 

layfui^)f rock in Oniqn Creek. Mandy, very carefully describe 
Juiit exactly what you cee. Don't try to interpret tfte obnerva- 
tionG, Ju:;t tell ml: exactly what you oe(»." ' ^ 

(e) 1*1)0 you agree with that, Joe?" 

Aftr»r you have* written your coding on a be^jarate rjheet of pai)or, turn 
to page 9fi. • ^ 
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(a) 1 — tf*acht?r it: acAilim ntu(if?nt:: to af^roe 

(b) hB — ^experimental deQign que.stion 

(c) — memory^recall 

(d) c!h — j'imple obr^ervation 

(e) dependj: on thf? context, u^ie coding!; rulej; IB and ?. 

If ^ 

If you mir:i:od any of th*»iu', r/^road th*? quf*::tion in 1 [^';ht of the? coding, 
above. If y(;u ran * t ^rerfumilo th*» qu*-ntion with th*» f*od(^ above*, 
plf'aso rp-rr*ad the (»at'»^»ory dericriijtirin. Aft*»r you hav*;^ d(jnr^ thin, 
codf? Uh? qufM'.t'^iorio beiov; in a r>imilar fai:hion. 

(a) '^Handy, r:upp(;r.o I give you a chemical analyr.i:: of the mica ami 
quartz and it teOln you that they botii have the iumf' ch(*mical 
componiti^)n an far an the perc(»ntar,en of each kind Of elemf»nt 
are concerned. ' liuir can you account fr^r the differencM? in their 
aj)fi)earance?" 

(b) O.K., all the data from^ Mendel *n *»xi)er imentn In in that handQirU^. 
y6u .)u:5t ^7,ot. I knovf you haven't ntudifMi it yet r.o thin nhould 
be real hard, but you can do it. Find a nimple rule from that' 
data v;hicii will allow un to i)redict. vrhat kin(3 of fjffnprirur, you 
will /-^,et v;hen you ^reed tv;f^ diff*?T(.^nt kindn of p^san . 

(c) "Jamen, v;hat i:; thin thin^r, I'm holdin^^ up?" 

(d) "Hov; about the tropicn, fjfunmy?^ 

(e) "Did you v/ant to nay nomc^thinf^, David?" 

After writing fiovm the code for th(» five quentionn above, turn to th*» 
next pa^v? . 
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(a) Uc — hypotheois formation 

(b) 3C — production of a right answer without the logical oystem 
* having been' taught 

(c) 2A — recognition and labeling 

'(d) o this question cannot be coded out of 'context and poaaibly 
not context ^ 
(e) 1 . • , 

if you massed any of these, please turn back to*page 96 and re-read 
the questions you missed in light -of the category assignments above. 
After doing this, please turrv to the next page and identify only 
those questions which should be coded hc* . ' 

I 

» n * 
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Please identify those questiona below v/hich ahould be coded ac kC. 
Do not code questiono which are not hc unices you wioh to do so as 
an additional exercise^ 

(a) "V/hen you go out on the ocean« it looks flat all the way to the 
horizon. If the world is really round, why doesn't the surface 
o^ the ocean appear to curve away from you*toward the horizon, 
Rubin?"-- 

(b) One thing that any plantp which. eat insects have in common is 
that they evolved in areas \rhere the soil was deficient in one or 

more nutrients • How can you exp!l^ain wl|^ this is the case, 
Melanie? 

(b) "V/hy does the temperature of water stay at O^C. ^1 during the 
time that it is freezing, Marianne?" 

(d) "I've written the physical characteristics for compounds A, B, 
i and Con the boar {i. Over here are five possible structural 

formulae for the three compounds, V^hich of those' structural 
formulas is not -associated with any o*f the. three compounds, 
Hugh?" ' 

(e) "How do you explain what vms reported in that TIME article, 
David? Hov7 could the fossils of land animals have been found 
in a core drilled from the bottom of the ocean fifty miles out 
from the nearest land?" 

Please . identify the questions which should be coded as^ and wite 
these identities on a separate sheet of paper before turning to the 
next page to check your coding. * * 
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All the c^ueotionD-^ire^i+C EXCEPT (d) which should Ije coded as' 3C^ 
ThiD andlyoio quection definitely hao a correct *or best* answer . 

If you correctly identified the Uc category quectionD., turn to the 
next page. . If, however, you misidentif ied one or more of the five 
queotionc, pleaoe tiarn to page 98 and re-:^ad the que£5tionr. , consi- 
dering the nhort discussion above. All of them except (d) are 
asking for hypothesis formation of one sort or another. 
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You are nov^^eady to resiime your interaction" w\th the transcript pf 
an 8th grade earth sciencer lesson which was' begun earlier. V/rite 
the questions which jroujMTould use at a spot designated in the. tran- 
script. Unless otherwise specified, you should write ONLY.UC questions 

T: Does anyoile else have an idea about what the sand might do? Ron? 
S6: I don't think it ^ a gonna' do anything. Thair Jack's not big enough 

and since it's i Jack-in-the-bpx , if it werV a big Jack I'd eat 

it' for Irnich, hee hee hee (etc! as he giggles over his Jolce) 
% (V/RITING ON board) O.K., Ron, you said it wasri't going to ct^nge 

because the Jack's not big enough. The layers of sand will stay 

the soine. Right?. . :Any other ideas, Becky? 
SIO: Could it break into two pieces and one of 'em slide over the 

top of the other one? 
"s6: Naw man. That's SAND! ! It's not gonna'do THAT I I 

T: I'm not sure I u^^derstand what you 'mean. V/ould you draw ^ picture'^ 
of it on the board? A picture of what the layers will look like 
after we apply the extra pressyre? 
(Student ^raws picture of what it will'ihdeed look like and then 
returns to seat) % ' ' 
•T; ^_ ^ - 

Please write a,UC question you could use in this situation. W^en you^ 
have written .y|||mr^uest ion , turn to page 102 *pl ease. 
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GO BACK TO PAOE 100. BE SURE TO V/RITE YODR QUESTIONS DOV/N BEFORE 
TURNING TO THE DESIGNATED PAGE. 



frame 102 



-102- 



Typical kc queGtions appropriate to this point in the lesGon are "V/hjc 
do you thiak she guessed that would happen, Charlie?*' and *^How doeo 
that work, if it does *that? If what she said were 'to- happen , Ralph", 
how could you explain why it did that?" 

Another common strategy which /several teachers write dovm and identify 
as 3B, even though the directions specifically requested a type 
question, is a question which requests that B^cky tell V/HY she pre- 
dicted what she did. Apparently many teachers feel that this question 
would be most appropriate at this point in the lesson. 

A third common strategy wjfil>ch' could be used might be to ask still 
another different studen^ to propose a dif f ercnt Jprediction. This 
kind of question would be. coded as UB. ^ 

If ^ou thought of a synthesis type of hc miestion, please writ^ it in 
the sp^ce below so we may use it in revising the module. 

'PLEASE CONTINUE YOUR INTERACTION V/ITH THIS LESSON ON THE NEXT 
PAGE. ' , 
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SIO 
T: 



T: 
T: 



•Gil 




That's real intereoting, Becky. Would you like to tell uo why 
you decided, that 'a vhatVould happen? 
No, I'll wait. - , 

O.K., doeo anyone elG^ have a different idea about what'a going 
. to happen when Joe turno the crank? • ■ • 

I think- it'll fold up into wr inkier.^ (PAUGE) You know, like a 
car\pet doeo Goraet.iraeo when you push on it. . .You know, like 
a carpet does when you try to -puoh furniture acrooo'it and 
not tacked dowrj^ 
.Y^u thix^i that the whole thing 'o gonna wrinkle' acroGC and /old- 
Uh-huh. , • ' 
0..K. (VJRITIKG on BOARD) We have, five different pieturai^pf what 
people think it'll look like. .Doeo anyone have ano^^er idea? 
Does anyone think it'll he different from one of t^ese ^pictureo? 
: Vfould you tell uo what they are all about agair " 
Sure. The one here that Fred and Laura decided oil Daid that the 
layers would get thicker* and that they would b/ thicker toward 
the end near the Jack "bhan at the other end • /Ron oaid it 
wouldn't Ghangg at al.l because the Jack iDnyf'big enough. Bdcky 
aaid it would ^bre^k and one layer would nlMe ove ithe other to 
give fioraething that looks like this picturrfe right here, with 
•t)art of the layero higher than the other/i)art. Rhonda oaid it • 
would get all mixed up and there wouldn/t be any layers left. 
Delina naid the layers would fold and y^inkle and 'end up looking 
;Like this. . .Are there are riny^ other/unggestiono? . . ,Io"that , 
'O.K.? Do you know j/hat all these p^turec reprooent? . .O.K., 
let's do it. 
G6: VlAITII Let's vote! Let's votel 



PLEASE TURN TO THJS NfiXT PAGE 
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S9: Aw come on, Ronnie, let 'a. get through do v;e can ctudy for our 

; Englioh teot. 
S6; Wo, I wanna vote. 

T:'" O.K., How many of you. agree with Fred and Laura (PAUHEJ Glx? 
(VJRITES 0N BOARD) How about Rhonda'D picture? (PAUSE) Two? 
(^HTEG) Allright, how .many of you think it won't do anything 
like Ronnie oaid? (PAUpE') Only one. (V/IUTEG) How many of you 
agree with Becky? That'o this picture right here. (PAUGE) 
Thre(5. (VJRITEG) Now how many of you think' it'll fol^ a^d - 
wrinkle^ like Delma caid? (COUNTS) Thirteen! (VJRITEG) VJowl 
A lot of people agree with you Delma. You munt have had a 
pretty good idea. That'n Junt- twenty-five. VJho didn't vote? 
(PAUGE) Luio", which. idea are you gonna vote for? 
G12: I'll go along with^ Delma, Gh^'o a good chicano, 
G6: Hey may, I ^m a chicano too. * 
T: VJell, T really don't think any of theoe pictureo are chicano. 
they ''re Junt pictures. Anyway, that makes fourteen for your 
idea Ddlma. Joe, how did you vote? 
Gl: I voted for Reeky 'o idea, 

T: O.K., well let'o crank it up and cee what happens? 
(THE DEf^OKGTRATION VJORKB PERFECTLY, CREATING A ClAiVSlC MINIATURE 
TflRUGT FAULT JUGT AG'bECICY GAID IT WOULD, WITH A GLIGHT THICKENING 



NEAREGT THE JACK) 

7^^:^--^ 


? 


VJrite a quention you feel is appropriate 
It may be any type of question you wish. 


to this 'point intlie lesson 
but identify the type. 


please' turn to the next page 
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Again, a number of optionc are poocible and manj/' different lUndo of 
queotiono can be allied, depending on what direction the teacher 
wicheo to take the claco, ^ 

Many teaeheiin^ choooe to aok a 2B queotion at thio point — a Dimple 
oboervation ouch ao "VJhat happened, Delma?" 

A second type of qucKtion would be to aok a otudent to match what 
happened with one"" of the pictureo on the board. Thin would be a 3A 
quection, since it io aok^ng the student to classify the observation 
according to p, given classification scheme (the set of pictures > 
would be the classification criteria)^ 

Another type of question might be to ask Becky why she predicted what 
so obviously Just happened. Since this is asking a studc^nt to explair 
the reasons behind an answer or "assertion, this w^ould be a 3B ques- 
t'io'n. . 

A fodrth option would be to ask someone to propose a hypothesis 
explaining why what happened actually happened. This would be a Uc 
type question. 

A fifth option would be to ask a procedural question: to q.sk every- 
one to draw a pic^ture or diagrQm,of the results, for example. 
If the students had actually, already studied faulting, many differ- 
ent kinds of ?A questions could be asked. In this case, the stu- 
dents had not studied faulting prior to the demonstration, so 2A 
questions would be inappropriate. 

Did your question match the characteristics of the category you 
meant for it to? If riot, write that type of question with the proper 
characteristics. Did you write a hC question? If not write one for 
fun and practice,' Then turn to page 106, 
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Continue reading the tranoeript below. Bo folo-playing the teacher 
in your mind go that you eon think of many alternative queotiono you 
might ack at variouo pointo in the leooon. * 1 

'^T: V/hat happened, Edward^' (THE TEACHER V/HO ORIGirJALLY .TAUGHT THE 

LEGGOn l-fflEIJ IT WAG RECO'rDED USED A POPULAR 
GTRATEOY — A ?B QUEGTIOn) 
G13: VJell, it looko kinda like a crooo between what Fred and Laura 

Daid and what Becky oald. 
yr: Then you're willing to oay that the other predietiono were not 

Dupported by the experiment? 
G,13: Yeah, I gueoo do. , , • 

T: Rhonda? 

S8: V/eil, I war. wrong. So what? It ain|t the firot time.' And 
DELMA wao wrong, too. ^ 

T: I don ' t think thereto any need to take that kind of attitude. 

Anyway, I wanted to aok you a queotidn, not paint out that your 
prediction xmon^t upheld by the experini'ent. \Jhy do you think 
it worked like that? Can you G^ee anytyjing that might help you 
to figure out why it did that? You can get up and come up here 
to look at it clooely if you think that'll help you anower the 
queotion. W\y did it do that inotead of one of the other thinga 
that wao predicted? ^ 

S8: (LorJG PAUSE) I ean*t think of a reanon:^ Ask Becky, it wao Hl^i 
ideal 

T: Good idea. Becky 3 why did you think it would do that? 
GIO: I don't 'know why it workn like that. 

T: How did you know to predict that, then, if you have no idea how 
it workn? 

SIO: I wan over at' (T'Oe'o laot night when ^he finished building it and 
we tried it. It worked like that! 

PLEASE TURN TO THE NEXT PAGE 
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T:,^ In other wordo , you weren't really making a prediction. , You had 

already oeon what woUld happen. 
[310: Uh-huh. 

T: O.K.J Margarita, who had the cloaeot prediction of thooe four 

people who had nev^r oeen it before? 
n5:' Fred and LaUra^ I gueoc* ^ * 

T: O.K., Laura, it fattened up at one end Juot like you and Fred oaid 
it would, but it aloo broke and nlid. VThy do you ouppone that 
happened? V/hat kind of a. theory or hypotheoio can you make up 
to expl^ain why it worked like' that? VHiy 'do you ouppooo it broke. 
and.Glid ao well ao fattening up and getting- thicker at one end? 

G3: Well, I gueoo (LONG PAUSE) W^ll, I RF^LLY thought it would 
ri'pple and fold like Deljna caid it would. T Juot wanted to 
vote for my idea beeauoe I wanted to be oure ooraebody voted for 
it. I don't have the SLIGHTEST idea why ANY .of it happened at 
ALL ^ , 

T; ' * ????????? 

* 

I'/hat wiieDtiono could you aok at thio^ point? Try to vrite down oeveral 
uptionn — one each for the following typeo of queotiono: , i4B, 
?B, 3B, and 3C. .Write down your queotiono before you turn' to page 
109. 
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YOU RECEIVED NO DIRECTIOnS TO TURN TO THIS PAGE, WORKIHG THROUGH THE* 
MODULE GCTS A LITTLE TEDIOUS AT TIMED BUT YOU HHOULD TRY TO FOLLOW 
Tlffi DIRECTIOnS IN YOU WAIJT TO GET MAX IMUT-l BENEFIT FROM IT, 



Even if you'rf not cure at tfiio pqint that you roally do want to get 
maximum benefit from the module, pleaoo turn baalt to pafie lOY and 
follow the dlrentiono. There 'n npt much lift to the written i)art of 
the module. You're olmoot through wfbh thio portion. 
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Pleano open the booklet vhich containn a nh'ort deocriptldn of thf? 
category cyGtem and the ruloo for dlGt^ngulohing be?tueen quentionc 
which are ^ory much alike entitled: THE QUEGTIOH CATEGORY GYCTEM— , 
DESCRIPTION OF THE CATEGORIES AI^D CODING RULES. 

Unin^^ the dencriptionn of the catef^oriec provided In thin book, 
ploaoe check your five quentiona 3B, 3C , UB, and ^C) to be 

certain that they ponneon the characterinticn annociated with'' thone 
typeo'of quentionn. Jf one or more of your quentionfi did not match ' 
thej^roup character iotica , pleane rewrite the quention or vrTte 
another different question which doec match the characterioticn . 
■« 

After you have checked each of your queotionn with the appropriate 
description of category character ioticD and annured yournelf that you 
are sufficiently familiar with the five categorioo to write queotionn 
of each type, turn to page llO. 
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BgIow you will find an^ extendod tranoeript, Pleaoe code the queotiono 
preceded by number n in parentehDeo an 1, 2A, 2B, 3k i 3B, 30, JiA, andy 
5 (If you feel* comfortable diotingulohing between 5A afid 5B, ploace 
do GO.) Write yotir analyoio down on a oeparate oheet of paper— the 
transcript is rather long and you wlll'-not be able to remember the 
codec for all t^ne queotiono without writing them' down. 

T: (l)^ ii^rod, can* you convince her that you're right? I7hy did you 

think it would cur^e up like that? 
GT: VJell, the Jack io not in the middle, • It's gonna puch harder 

againot the bottom than it io the top. (PAUpE) That'o gonna . 

eauoe it to puoh like thio, . . .See what I mean? 
Gl: The board io bolted to the ^bop of the Jack Fred. I don't think 

that'o going tp make any difference, becauoe the preooure io 

applied pretty evenly all the way acrooo. 
07: Oh. . .well in that caoe, ohe^'o probably righh, 
T: (Writing on B0ard)| O.K.,.yi'll both think It'n gonna look like 

thio after he puto the pret:oure on. (9) Right? 
07 6 3: Yeo & Uh-Huh. 

T: Rhonda, you're ohaking your head back there. Do you think it 

might do oomething eloe benide^o that? 
G8: Well. . .it might. . .Oh, tha^^'o O.K., I'll Juot agree with 

thom. 

T:pO.|C/, oo you oay it>G gonna, look like' thio too (V/riting on board). 
[>8: V/ykit, don't write m^ name up . there I 

PIJEABE COWTirTUE ON THE NEXT PAGE 

/ 
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T: I^ut you oaid you thouf'.ht it vmo f?;onna look lik*> thin, Jur.t IUk' 

Frod and Laura. You aprood with thorn, 
nft: V/r>ll, writG FvfHi and Laura* n name up thf^re too. It'o really 
' tholr idea. 

T: (V/ritini3 on board). O.K., Fr^d and Iiaura arui Hhonda all think' 
*that it'n p;onna look liko thiir. after Joe putn tho proaouro 
oTi with t)io jank. (LOno ?A\nW,) ^ " • 

i)H: I KMLLY think it'o ^oinf^ to p;pt Jumbled up ton<^thor in a hid 
menn anfi you'^won't oven be aY>lG to tell that there ar^^ any ^ 
layern, oo Juot erane MY^ name. (LONG PAUHK) The^ layorn are 
fyjfnt to Ret all mixed uj). There won't BE any more layero . 
after he eranko that thing. (LONG PAUnKT" Wei 1 , draw a 'picture 
of THAT andput MY name beoide IT. 

T: (VJrit^rfi^! on boardj i'i) Like thin?' 

i)f)i Yoah, tJiat'G O.K. 

T: (H) VJhat d^ yrm think in goixir, to happen v/hen he turnn the 
orank, .Hf>5canne? VJhat are the layern (;f nand ^^jlnf^, to look 
like o^er he turno the crank and puto prennurGi on them? 

n9: iUr? . ^ 

T: I r;aid {i>) V/hat do you think io f^^oiw^ to hapy>f>n when Joe turno 
the 'Jack-crank and puto a lot of preooure on thone layero of 
oand? ' ^ ^ 

[)9> Ohi I agref^ with v^tot Rhonda oaid.. 

T: V/hat DID Rhonda i^ay? 

Wellll 11111? (LONG Vhin^K) 

lU'iAnr: ce)OTirjtJE coding thk: TRANiuMuni' on, the 

NEXT page- 
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T: 

S9: 
T: 



S9: 
T: 



She should have 'been listening. 

r-1 . 



Rhonda, don't tell her now. 
Roxanne? 

I don't know. .1 was studying English. 

RoKanne, don't study another subject in my c1q.ss unless I giV^ 
you permission. 'Rhonda, tell her yhat she agreed with while I 
wite'h'^r name up here* on the board next £o yours. (LONG PAUSE 
while this is being done) (7) Roxanne, do you still agree with 
Rhonda n6w that you know what she said? ' v ' 

Yessir, I guess so. . . * " ^ * 

O.K., now pay attention f or ,,the remainder of tbe period. If we 
get through early , you can have some free time to study 
English. (8) O.K.? (9) Doqs ^anyone else have an idea that 
is different fr^^^^these^Vo? Bonnie? ^ ... 



After coding these questions on a separate sheet of paper, turn to 
pa^e 6 of 'the. key booklet to check your answers. ' . 



or 
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The last category (HOORAY!!) is that of EVALUATION aqd there are ,two 
iQvelQf^A and B, The flrot is a simple type of 'evaluation queatiou 
which aokG a Gtudent to agree or disagree with a statement , point of. 
view, etc. 5 made by the teacher, another student, or' oome other source, 
Both choices, must be viable options, equally acceptable as evalua- . 
tions. ^his is why "evaluating" answers to 2A, 2B, 3A, 3 B, ewnd ' ° 
3C questions with an agree/jiisagree are really not considered as 
evaluations: because only one of the two choices is really accept- 
able or correct. 

Below are five questions which should be coded 5A or other.' Please 
code them' on a separate sheet of paper, ^ ^ 

(a) "Do you tliink Rodney's idea for doing the experiment will help cp 
us answer the question, Lisa?" 

(b) ".Robert Earl said the formula for Sodium was Ne, Do you agree 
\rt:th that, Celita?" 

(c) \ "Chei^ise has proposed abstinence as a good' way to stop the 

population explosion. Do you think, she's right , -Karen?" 

(d) "Do you disagree with Patrice, George?" 

(e) ^"V/hy do you think that abstinence isn,'t a good' method for 

birth control,* kar en?" 

PLEASE TURN TO THE NEXT PAGE 
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(a) .5A 

(b) 2A — this obviouoly followD a raemory-recall queotion^ The only 
correct response to this question io "Disagree". 

(c) 5A - y , 

(d) ?? — The context io necesDary to identify thio queotion. With- 
out context clueo ouch ao what is being agreed or diDagreed 
with, the question rauot be coded aa o. 

(e) 3B — student is being asked to cite her reasons for evaluating 
the way she Juot has. 

If you massed any of these, please reread the question in light of 
the coding and/or explanation provided above. If you sti^l disagree 
with the coding, re-read the discission of the specific cate- 
gory characteristics contained 'in the booklet describing the 
category system and coding rules/ 

After you are satisfied with the above coding of these five ques- 
tions, please turn to the next page. i . 
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BELOVi-IS A DISCUSSION VmiCH WAS RECORDEfD IK A SENIOR PHXSICS CLASS 
DURIilG THE SPRING OF 1973. Pleace cod| the ' teacher ' g queotions with 
thd-catfegorieG you have learned through 5A. If you can, code the 5B 
qu^^Dl^ionG appf^^priately as well. Write your analyoio dowfi on a 
separate oheet of paper. 

SI: VJell, I tU^n^ that one of the mai^ reasonc why we did ouch 

terrible things in "ITdet Nam i-o beqauce the ccientists invented' 
such terrible tilings like nd.palin p.nd defoliants and other stuff 
liHe that. If it weren't fcyr the thingp scientiats ^have in- ' 
vent'^d, we wouldn't have been able to do "aH^ that maiming, and 
killing and stuff. • / • 

T: (a) Do you really believe that science i^ what 'caused 'the maim- 
ing and killing, Carl? ^ * , ' , 

SI: (PAUSt; V/ell, not causes, no, but it maizes killing a lot more 
efficient and painful. V/e praptically killed off an entire 
race of ^people and. . .well, I guess. , .Uh, . .V/ell, genocide 
Ju^t wasn't possible like that until this century with all the 
w(5nderful scientific and technological advances. 

T:* (b) Do you agree with him, Debbie? 

S2: Agree with what? He said a lot of different tilings. 

T: O.K. Let's break it down. Let's t^ake one point at a time. 
Carl, if I^^get what you are saying wrong, don't hesitate to 
break in and correct me'. Now (siting on board) Point one — 
Genocide wasn't possible until thi^s centure.' (c) Do you 
agree with that? 

S^2: No. . 

T: (d) Why not? ^ ' ' 

PLEASE TURN TO THE NEXT PAGE 



-il6- 



PhyaicG claGC diocuGsion of war^, genocide and ocientioto' reoponoib- 
ility — continued 

S2: Anyone who han ever studied their Old Teotament knowG that the * 
Acoyrianri carried off the 12 tribeo and committed genocide on 
' 'them. All the Jews today are deac ended ijf rem one tribe. The 
othero were dei3troyed. That'o genoci'dd! • • . 

SI: 0.K-. , I'll retract that statement. ComntrieD hav^ practiced 
•genocide before this century. But we're a lot better at it 
J because of our advanced science though. 
T:/ Carl, you've mentioned genocide two or three timec already. 

/ '(e) Why do you think the U.S. Array in Viet Nam committed 
/ genoj^ide?. Do you have any evidence or observations to support 
that? 

SI: V/eli; I kind of kept up with the body count every day for about 
a year. . .As a» kind of game, you know?., . .anyway, if you 
compare the body count of the quote enemy unquote dead reported 
by" the army every day with the population figures reported for 
the. countries involved, yo^ get .the idea that we killed nearly 
all the people. That's geribclde and we'di^ it with out bombs 
and stuff. ^ , . . ^ 

T:> Oh I see (P^USE) (f) Do you think that' logic is O.K. , Nan^? 

S3: Nbssir. . .In the first place, tjie army's estimate of the 

enemy killed was probably inflated a little bit. I mean they 
lied about ^everything els6, so why not casualty figures?. . . 
In the second place, the population wouldn't be static. It 
would be increasing at an exponential rate,' especially in 
Southep.st Asia, and any killing would have to slow down the, ^ 
uh, the rate of increase of the population growth before 
genocide began. . . v 

PLEASE TURN TO. THE NEXT PAGE TO CONTINUE READING 



113 



frame IIT 



T: (g) Cai*l, would you like to rqnpond to the pointc Kan made? 
SI: V/ell ^ ahe'o probably right about the army lyin^. mean if 

tfliey hadn't been conoiotently lying about the casualty figureo 
, . .if we'd have really killed that many of them we'd have 
won the v^ar instead of getting beat like we did, (PAUSE) 
Well, Ghe'o probably right Rbout the population growth tob. 
vi mean what che imyc makes a lot of senoe. (LONG PAUGE) O.K., 
I'n retract that otatement too. Vie really didn't kill off 
the Indochinece yellow peril. (LONG l^AUSE) But I otill think 
^ha"^ Dcience io a great force for evil!!! 
T: ft.IC, we're back to whAt got t'he whole thing started in the 
/first place- (h) Do you agree with hira, Laureen? Do you 
\ f eel that ocience is a gfaeat force for evil in the world? 
SUi V/ell (LONG PAUSE) acientipts invented jiopaJ^and tha-fs evil 

■ especially when .they use it on people. 7\. 
.SI: VfflAT ELSE IS^IT EVER USED 'ON? " \ ' • 

Sk: Carlton, huoh up and don't interrupt me. You been talkin' 

kll mornin ' l!t Now, where was I before I was oo RUDELY inter- 
rupted.^ (PAUSE) Oh yeah. - . But scientists invented penicillin 
too and that's heipedfto save a lotta lives. "(PAUSE) And 
b^cvides that, if i'^f/eren't for t^e scientists, you wouldn't 
h^ve no electrifi^^f^t'ar to play Carl. You wouldn't be able to 
pl^y so loud hurt everybody's ears. 

After you have coded the teachers questions on a separate sheet of 
paper, turn to page 7 in t&e key booklet. 
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The laot category 5B: More complex evaluation, . Below are. o ever al 
evaluation queotiono. Pleaoe read them:^ 

(a) "In termo of how well the queotion will be anowored once the 

data bao been collected, which of theoe three experimento io the 
beat one, Lee?" , ^ . 

(b-) "Imagine that you're marooned on a deoort inland with two of the 
• people in the clasD and you know that you won't be reocued for 
Dix montho. If you wanted to ourvive for thone oix monthc, who 
would you choooe to be the two peroono from thio claoD to be 
marooned with, Monica?" 

(c) "O.K., you're a Judge and, eocentially, the problem in thio: * 

If you find' in favor of the pollution control board and make the 
chemical plant ohut down until they can deoign a method for 
adequately treating their waDteo,'800 people will looe their 
Jobo. ^ There 'd a good chance that the chemical plant Vill never 
re-open in that community which d^pendo on it ao the lorgeot 
employer in town. If you find in^faVor of the chemical company 
and grant them an extra amount of time which they have requeoted 
for developing a way to treat their waste*, the lake into which 
they muot dump that waote will certainly die. \fliich way would 
you decide thio cace^ Johnny?" 

(d) "\^hat do you think io the worot pollution problem in Auntin, 
Sandra?" 

(e) /''V/hich of theoe expe^imei7to would you rather do, Ruby?"* 

After reading the queotiono above, you ohould be able to Identify 
5B queotiono. VJrite down their diaracteriotico in your own word5 
before turning. to the next page. 
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In order for a quootion to be eatogorisod' qo SB, tho otudont ohould 
be required to evaluate and ehoooo at a more eomplox level than ^ 
oimply Qgroeins or dioagreeins with what oomeone eloo hao already 
oaid. Tho criteria for evaluation may be internal or external but 
a ehoiee from among altornativeo, a. ranking of alternativeo , or a 
rating of the deoirability and/or value of oome alternative ac 
oppoced to otlfer altfernativeo (not alwayo VGlfbalised) ohould be. re- 
quired for-anowering 5B queotiono. 



PLEASE TURN TO THE NEXT PAGE 
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YOU HAVE FIHISHED TIIE V/RITOT PART OF THIS MODULE AND 'OHOULD BE RMDY 
AND ABLE TO ACCURATELY CODE Ti^&NSCRIPTS USING THE QUESTI.OH CATEGORY . 
CLASSIFICATION SYSTEfjl. PLEASE TAItE THE BOOKLET TITLED rvritten 
program exit aaoeanment AND CODE THE FIRST TRANSCRIPT. 
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You havG eoiiiplGtod the written prof^rom Gomponont of the modulo and , 
you ore now ready for ypur final examination in catecorislns queotiono^ 
in vrritten trGnocriptD*. ^ Your criterion co^l for eatecorising written * 
quGotlono lo 80p aaeuracy. , if 

Below, and on the next oever^il pa^eo, ^a iranocript of an audiotaped 
chemistry leocon. ^The otudent^ are .college bound -DophomoreD, Junior □ 
and DGpiorc. To oet the otage, the teacher hao walked in owirling a 
liquid in an erlenmeyer flaok. IThon the teacher ohakeo the liquid, 
it turnc blue; when the liquid io allowed" to remain undioturbed for a 
few oeeondD, it turno back colorleoo. 

Gl : Vftiat'D that otuff in the flaok? . 

T: Well, that'D a pretty good queotion, Phillip, (l) V/hat do you 

□ee? • ' / 

SI: Some liquid that tyxvxiu blue when you ohake it, then txirnc back . 

clear again. 

T: O.K. (2) Id there anything gIdg in the flaok. . .uh. . ,Kent? 
S8: I don't know. I can't oee it over here. 

T: Oh! O.K. Ya'll paoD thio back to Kent. Be careful not' to drop 
it or take the ctopper out or anything like that. Kent, you' 
can Dhake it and everything but be aure to hold the otopper ♦ 
in. (LONG PAUSE) . s 

S2: Well, the bottom of the ctopper io in the bottie. 

T: O.K. (3) Anything eloe, Mary? 

S3l Naw. (LON(f PAUSE) (U) Id ^here anything eloe in the liquid? 
. . .1 nlean, it 'a not Juot one thing Id it? 

T: That'c a real good queotion. No, it haa KOH, glucooe, and J 
methylene blue d'ioGolved fn water.- I'll write down the otruc- - 
tureo for theoe two on the board. V/hil0 I'm doing that, pano 
the flaok around and oee if you can figure out how it changeo 
color D. Junt be careful to hold the otopper on when you ohake 
it. . ' 

(much hubbub, confusion, TALKING , /CHALK SCRATCHING ON BOARD, ETC.) 

T: O.K., Pipe downll. . .(5) Hao everybody had a chance *to look 

at thio Dtuff or play with it? Derwood? Somebody paoo the flank 
ov6r to Derwood. (PAUSE) O.K. (6) Does anyone want to hazard 
a gueoD ao t'how it worko? (PAUSE) Diane? 

SU: I want to aok a queotion, 

T: O.K. 

SU: (?^ lo there anything on the otopper? 

T: (8) \What do you mean? I'm not cure I understand exactly what ^. 

you'nsi aoking. ' - / 

Sii: V/ell, wien you shake it up, the solution toucheo the otopper aijd 

I wac Juot wondering If maybe there waon't aome oort of ch^cal 

i 
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- or Domethdng on the otoppor that mado the polution (Chance 

eolor. Then when the oolution folio baek Into the bottle, It'cf 
not touehlnc the otoppor anymore and it might change t)ack to . 
the original eolor, that io if there io anything on the otopper 
I mean. (LOnO PAUSE) Well, io that how it worko? 

1": IIirjHinMa. {$) How would you teot to oee if her hypotheoio io a 
viable qi)e, Duoty? ^ " ^ 

35: I Juot ICIJEW you were gonna aok me thatlll (PAUSE) We could get 
, ^ a different otopper and try again. 

B6: He* might have put chemical on all the otopperoK 

T: (10) Do you really think I'd be that oneaky? 
"V--:. (CHORUG OF YEAH,, GURE, OP COURSE, YOU SURE WOULD, ETC., m^CD 

T: O.K. (ll) VJhat could you to do inoure againot my chicanery, 
Barbar^?" 

G7; Your wHat? 

T: Chieaii^yT That meano trickery. 

ST: ' Oh. . . .V/ell, we could waoh off the new otopper. 

S6: The chemical might 'not be water oolubleltl ^ . 

T: Aw come on Allen 1 Surely you don't think I'd go to that much 

trouble. (12) "Wliy do you think the chemical if on the otopper— 
if ^there io one — might not be water ooluble? 

S6; V/ell » . .uh. . .it Juot might not be, and we ought to be nure. - 

T: (13) If there io a chemical on the otopper, what oboervation 
might indicate that ft'o not water ooluble. , .uh. . .David? 

S8: I dunno. (LONG PAUSE) Well, I really don't. ^ If I did, I'd 
,TELL you. 

T: O.K.. . .(lU) Wanda? 

S9: I didn't under otand the queotion. 

T: Diane oaid that -the reaoon the otuff changeo coloro when you 

Dhake it io becauoe there 'o ^a chemical on the otopper that one 
of the chemicalo in the oolution reacto with to turn blue. 'Then 
ohe oayo something eloe in the water makes the blue otuff turn 
back colorleoo when it'o not hitting- the chemical on the otopper, 
anymore. Allen oayo that the chemieq,l on the otoppor, if there^ , 
io one, might not be ooluble in water. (l5) Do you know what 
ooluble m^ano? (PAUSE) O.K. then, the queotion io thio: (l6) 
Vmat OBSERVATION might oupport Allen 'o hypotheoio that the 
chemical on the otopper would not be ooluble in xratpr? 

S9: VHiat oboervation?. . .1 don't think there io one. . .(PAUSE) 

Can I look at it apin? (LONG PAUSE) Well. . .uh. .v. (LONG PAUSE) 
OH SURE I If the otuff on the otopper would diooolve in water, it 
x^ould diooolve when you ohook the flank and would otay in the 
oolution after that. It wouldn't ever turn back to colorleoo 
becauoe all the otuff on tho^otopper would diooolve in the 
water Juot like the other otuff — the glucooe and KOH and that 
other otuff. It HAS to be inooluble in water. 
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iV{: V/o could wQch off a dlffGront otoppor with mme of that otuff 
that amello liko glue or with gaoolino. That would take eare 
of it. 

T: O.K.i Barbara oayo to waoh off a different otopper with oome 
non-^queouo Dolvento like acetone and gaooline. (17) Id that 
O.K., Allen? VJould that take care of the problem? 

n6: Uoe benzene too. 

SIO: And ether!! Uoe ether tool * . 

T: O.K. A21on nayo to uoe bensene and Lamar oayo %5 uoe ether, no 
we'll waoh off the new otopper with acetone, gaooline, bensene 
and ether. (l8) Do you t^ink we ohould do anything eloe to the 
new otopper uh. . .Tanya? ^ 

nil: Wo, that'o enough. . ^ „ , 

T: (19) Gioelle, how about you? 
• L312: You might ooak it in acid for a f)iw oecondo. 

T: (^>0) Why acid, why. not baoe? , 

Ij12j If a baoe would react with it, I gueoo KOH in the oolutioi?^ 

would^have already reacted with it. And acid eato up a lojj of 
different thingo too. 

T: Hey, hey! That'o pretty oharp thinkine! {?.!) What kind of acid 
could we uoe, Katherfne? • 

S13: A lot of different oneo. HCl, HgSO|^ , HNO^, HOAc. (PAUGE) 
ThODo are oome ocido. 

T: {22) Derwood, can you think of oome more acidn we might une? 

VAhi V/hlch one^o did oay? 

T: That*o a very good queotion Derwood. (P3) Which one'o did 
ohe oay? 

mil: ' Uh. . .1 wann't liotening. 

T: Yo)i ohould licten Derwood. You'd be ama^ied at 'the reoultn you 
will have. Ghe oaid hydrochloric, oulfuric, nitric and acetic 
acidc. now.(?H) what are oome other poooibilitieo? 

niU: Uh. . .hydrofluoric acid? 

T: O.K., that'o a good one. (25) Can you think of another? 
C1^4: Phoophoric acid? t 
T: That'o another good, one. (PAUGE while writing on board). ('26) 
VJhich' acid do you think we ohould uoe. . -uh, let'o nee, who 
haven't I nailed on yet? Honnie? VJlilch one of theoe acido ohould 
we waoh the new otopper with? 
G15: HCl. , ? - 

T: O.K. (27) In that all right with everybody? . ' 

Glh: Naw, I wanna uoe phoophoric acid. 

T: O.K. let*o uoe both of them and then vre can be cjouble ouro. (28) 
Phillip, would you and Kent go and get oome acetone, benzene, 
gaooline, HCl, phoophoric acid, and. . .uh. . .oome ether? . . . 
•and ajnew otopper? It'o a number three if you get a rubber 
stopper. 
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(LOIJG PAUCE during which the chemiaala are^ fetched, OGVcral otudGnto 
participate ip vaahingtho new otoppor, etc. otQ.) 

T: O.K., Allon and Barbara approve tlie otopper waahins do we're ready 

to teat Diane 'o hypothecio. ^ 
(PAUG&. followed by choruo of "Oh, IJo," "It turned blue, "etc.) 
T: Well, it ntill turned blue. {29) How what. . .Laura?' 
ni6: Could wo oboerVe It aome more?. 

T:- (30) Are you going to oboerve it differently from the way you 
did the firot tlBie? - • ■ ^ ^ 

Sl6: Uh. . *.V/ell. . ."^^vorybody wao paooing it around and all that 

^ and it never did turn completely colorleoo like everybody in 
.oaylng that it did. . .But It'o colorleoo ITOW. Could we Junt 
kind of look at it while it'o oltting up tlhero on your dt-'Ok? 

T: O.K. , ^ Oboerve away. (31) Dooo anyone want to get up and 

oboerve It? I'll give you. . .two minuteo. (LONG PAUHE) All 
right everybody have a oeati (32) Did anybody oee oomething 
different thio time? 

(SEVERAL GTUDENTO AHGV/ER OIMULTArJEOUSLY AND NONE ARE UHDEROTAnDABLE ) 

T: Kenneth? ^ 

fil7: I know oomething eloo that'o Ui the flaok. 
G6: V/IIAT? 1 1 1 

S17: Air. That'o what makin' At turn blue. The Dtu^T io reacting 
with air. 



T: (33) V/tmt oboervation led you to thdt hypotheolo , Kenneth? 

Ank Lauri^.. Ohe'o the one who nhowed it to me. 
ni6: Chowed you what? 

T: (3^0 Did you ohoxf him any of your oboorvat ionn , Laura? 

ni6: Oh, yeah. . .V/hen you kneel and look up through tjie nolution 

from the bottom, it looko like the top io real blue, kind of like 

looking up into the oky except a different color blue, Juot like 

the color when yoti nhake It up. 
T: (35) How do you think that convinced Kenneth that air in what'o 

turning the oolution *blue. . .Chrio? ^ 
[]18: It'o Iil£ hypotheoio. Aok HIM I 
T: V/ell, I'm aoking you right now. 
Dl8: I'Jell 1 don't know. 

T: I know you don't know what he thought. (36) How do you think th^t 

Lriur.a'c oboervation relateo to Kenneth 'o hypotheoi^ 
Gl8: (LONG PAUSE)- V7ell. . ,(PAUr>E). . .T]riere oure iooMr in there, 

that'o for oure. . . .1 don»t know (LOKG PAUGE) I'Jell, I juot 

don't' have AHY idea. 
T: (37) Kenneth, would you explain to all of uo how you reached that 

hypotheolo? 

317: .Chrio, wlmt'o thq only thing in contact with the ouvface of the 
water all the way acrooo? ^ y 




Sl8: (PAUSE) Air, I gueoo. 
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UITj ' V/hrit oolur Id* the ourfaoo of the water all tho way aerooo if 
^ you look up at it from tho bottom? 
:nH: Blue? 

017: Rlr,ht^ Co what hao to bo turning It blue? V/liat'o the only 

thing that'o touching it where it'o blue? 
niB: OHf OF COIJROE! Ito MRI L. . ,3uroIl! 

u6: Vfhy doeon't it look blue when you look down on it from the top? 
T: That'n a good queotlonj Allen. (i8) VJhy doonn't it look blue 

frorn tho top Kenneth? 
iiVj: ~I don'.t know. It ohould. I didn't look at it from thf} top. 
T: Well, (39) Why don't you got up and do it now? (LONG PAUGE). 
TilT: Allen, you duMny. It (|uen look blue from tho top. 

Huh? Lormo oeo. (LOWG IWIHE) You're right. It l£ blue from 

the top. 

T: O.K. (ho) i"o how eould you toot hie hyiJOtheoin Derwood? 
Cdh (PAIK3E) Take tho air out? . > 

T: O.K. You oould take the air out. {hi) How oould wo do that, 
Sharon? 

[il9: Hook it up to the aopirator. (PAUSE) V/oll, we'd have to get 
another otopper. . .one with a hole in It and como glaoo tubing. 

T: (hp) How could wo kdep the air from going back Into tho flaok 
-once"* wo had pumped it out? 

S19: Well we could. . .(PAUSE) 

IHT: Uno a tube with a otopcoek in it. 

S19^ Ypah. 

T: That'o an oKcollont ouggeotion Kenneth but I wiah'you wouldn't 

break in on oomeone like that, {h^) Do you think you could try 
to refrain from doing that in the future? If you'll hold up your 
hand you'll eventually get a chance if the p«>rnon already talking 
dooon't think of your idea flrot. 

SIT: I gueno no. 

T: O.K. Good. . . .V/ell, let'o do it. I junt happen to have here a 
number three one-hole rubber ntopper with a ntopcock and vacmaa 
tubing attached. 

(Choruo of boon, hinnoD, ^^ytm had it planned all along,** etc., etc.) 
(LOno PAUSE v/ith Dound of running water) 

T: {hh) In thin long onough^or do ya'll want to pump on it a little^ 
v/hi'le lr>ngejr? 

(Choru^r of "LONGM^" followed by another PAUSE with running vmter) 
T: O.K., I've cloned off the ntopcock. -IK)W']et'n try it. (PAUSE) 

(1*5) VJhat happened, Kenneth? > 
Sl7: It turned blue ntill. . ."but it vmnnt an blue an before and it 

turned back quicker. Do it again. 
T: O.K. (U6) now what? 

SIT: Well, it didn't turn blue no that proven i-tr. ^/ 
T: (Uy)' Proven what? 

G17: That the air wan what wan making it turn blue! 
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T: (U8) Is that allSright with everybody? Are you willing to- * 
accept th"is as evidence that the air . wasfwhat was causing the 
blue reaction? . . 

(CHORUS of "yeah/; "siire/-' "It was the ,air," and so on) 

T: {k9) Is the air a chemical compound, Lamajr? ^ J 

§10: Mils' be. / 

T: (50) Wanda^ ^ . ; 

S9: No, it's a mixture of gaseous compounds and elements like 

nitrogen 4rid oxygen and carbbn ^dioxide. . ■'^^ 

T: That's I'ight. (5l) Lamar, ^can you think of another constituent 
that might be in the air? ' ^ ^ 

SIO: Uh^ . .helium? 

O.K.^ (writing ^on board)\ (52)^ Any more, Mary? 

S3:(f: Hydrogen, Argon, Xenon, Neon. " -->^ 

"T: l?hat makes eighty real' good ones. ' (53,) Can anyone think of more, 
Sharon, did you have your hand up?* 

S19: If it's polliuted air you might*^have carbon monoxide- and ozone 
and nitrogen dioxide and'^^svilfuj:^ dioxide and all itinds of stuff 
like that guy told us abou"^ in assembly last week. ^ 

T: (5H) Do you think the air in the flask was -polluted? 

SI9: Nossir. , 

T:. O.^K., well then let's leaVe those ^ff the List — but Ihey wduld 
certainly be possibilities if ovir air were polluted like it is 
in Jackson. . . ^,0^^ N , .CO , argon; He,' Neon, Hp, and ^XenT^Nik, 
That really about covers it. (55) l^ich one of those compounds 
do you think is most likely a culprit. . .let's see rxbw. . . 
I haven't called on Lisa, yet". . ."W^hich of these constituents 

, ' do you think is most likely to be causing the reaction, Lisa? 

S20 : Oxygen - 

T: O.K., oxygen. (56) Jan, do you agree with that? 
S21: Yeah, that's O.K. « . \ > ^ 

T:^ (57) -Why do you think it might be oxyge^n, sJan? | 
S21: I. don't know. ^ J just agree with Lisa. 

T: Hmimraranm. Thaf's not a very safe way to .get your ideas. (58*) 

Do you always depend on other people to tell you what to think? 
S21: I su?"e do^in chemistry. 

T: O.K., I ^ess that's fair if you're willing to trust 'what she 
has to say^. -^'(59) Sandra, why do you think Lisa said it was 
oxygen? . - * 

'S22: Sir: , " , , * ' 

T: (60) Why do yoti think Lisa said oxygen was the gas in the air 
that caused the stuff in the^ solution to turn blue? 

S22': J ddn't know. - ' ^ ' 

T: (6l> Well, if you had said oxygen, why would you have^said it? 
S22: I wouldn't say 'oxygen. I'd s^y CO . 
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T: Gh, I^see. O.K.,' then, (62) why would you say carbon dioxide? 

S22: Because. . .uh. . .Do you remember when we. .. .uh (LONG PAUSE) 
No that was in^ biology last year. (PAUSE) V/ell, anyway. . . 
CO2 makes things turn whit'e^ when you blow your breath into 
solutions through a str'aw so maybe that's what makes this solu- 
tion change colors.^ 

T: WOW! Coach Gaston is really gblhg to be pleased when I t^H him 
you're applying what you learned last year in his class to/ 
chemistry this year. . . .Let's see if I can get thig,,i*aii^ght 
now. You're saying that 'the CO2 in your breach makes S({mie j 
solutions like barium hydroxide turn white and since it caV(^eG 
*a color change in that reaction, it might be causing a color 
change in this reaction, too."' (63) Is that about right? 

S22: Uh-huh- I 'guess so. 

T: That's a pretty good hypothesis. Ronnie. . . 

S15: I know.' (6U) How could I test her hypothesis? 

T: Well, that's not the question I was going tooask and I'd appre- 
ciai^e^our not interrupting me until I finish talking. I'll 
give you the same courtesy as lon^ as we're talking about , 
chemistry- (65) Now, would you like to agree with one of these 
hypotheses or do ^ybu have a third possibility? 

SI5: Oh (pause) Leeme see, . .uh. • .that might be nitrogen. 

T: (Writing pn board) Nitrogen. (66) Why not one of the others, 
Phillip? 

SI. -They're all inert except hydrogan and there's not enough of 

that in the air to worry with. 
T: O.Kf. {6lT Does anybody disagree with that? Lamar? 
SIO: Why don't you Just tell us how it works^ and then we'll know? 
T: Lamar', I must have answered that question for you two-hundred 

times this year. I'm not goin to go into it again. (PAUSE) 

(68) ' How could you tell which one of these might be right, 

Kenneth? 

SIT: Well, we've got little tanks of 02and Np in the storeroom. 

Have we got any dry ice leiTt over from the experiment we ^did ^ 

Friday? 
T-, Uh-huh. I thirrtt so. 

SIT: Throw a piece of dry ice in the solution. If it turns blue 

around the dry ice, CO is doing it. If it turns blue when you 
bubble Op or Np through it, then that gas is doing it. . . 

T: (60) Is that 07K. with- everyone? (LONG PAUSE). 0,K. , I'm going 
to use this deflagrating spoon to put e piece of -dry ice down 
in the flask. That way we can' get the. dry ice back out. 
Everybody watch. (PAUSE) Derwood, turn around and pay atten- 
tion. You should be watching this too. (LONG PAUSE) . Hmramm. 
The dry ice doesn't seem to be having any effect. Let's try 
nitrogen. (LONG PAUSE) (TOL^.K. , what's happening Sandra? 
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S19: It's turning blue a little bite, especially jaear the top. 

T: O.K., then let's ti*y oxygen , and see what happens with that. 

(long pause followjed by "Oh wow'', ."Far out,*" "look at that," etc'.) 

T: V/ell, I guess Lisa, was right. That sure was excellent reasoning 
that Sandra had though. I'm really impressed. It ^ust didn't 
happen to work this time. (T1) Lisa,^why did you think it. 
would be oxygen instead of one of these other gases? ^ 

S20: 'Wfell,' Oxygen reacts with a lot, of different things and it makes 
up dbout. . .'let's see, what was it? (PAUSE) . . .about 30^ . 
. . .about 30/? of all- the stuff that makes up air. 00^ is real \ 
reactive tOo but there's not very much of it in the air. That's V 
why you have to breathe through a straw in biology instead of J 
Just pumping air in it with a bicycle pump or something. So f 
I didn't think there would be enough of it in the air ..to keep 
making the color change and change and change without ever 
taking the top off, (PAUSE) It would get used up faster than 
that since there's not veiiy much of it in the air to begin with. 
. .^ou know? . . .(pause) Well,'*I could tell that something 
in the air was being used up because wKen you torok •the original 
■ stopper out.' . .you know, to put inthe specially cleaned one? 
. . .anyway, it sounded like that. . .like there was a vacuum 
in there. '(PAUSE) -So I figured somethi-ng in the air was being 
used up. ■ And we've already learned that nitrogen isn't very 
* reactive as Np, so oxygen was about the only thing it could be 
. . .you'* know7> ^ o [ ' 

' T: ThaVs really far OUT!!! I am continually amazed at the way^you 
folks can think when ^ou set cranked. Phillip and Allen and 
Kent are usually the idea men — excuse me, the idea persons — - 
and today already, Kenneth and Wanda and Sharon and Diane and 
Giselle and ,especially Lisa have. had some really suppr ideas and 
thinking. Some other. folks like Derwood and Barbara have come 
up with some excellent experimental designs which is at least 
as important to 'doing science as thinking up theories is. I 
am really impressed. (72). It couldn't be due to the Tact that 
I'm taping the lesson, could it? (PAUSE) Yes? Well, I think 
I'll Just tape every lesson from now till the end of the semester. 
I don't know. 1^ I did that ya'll might end up being chemical 
' geniuses and I'm not sure we could stand ?H.^niuses in chemis- 
try in the saine classroom. • .or even in the same town for that 
matter . 

After you have coded all 72 questions in tiis transcript on a separate 
sheet of paper, turn to page 8 of the KEY BOOICLET to check your coding. 
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Written Program Exit Assessment: treuiscript two- 

If yovi ore coding this transcript for fun, please begin "belov. If 
you are coding it because you«did not code the first Exit Assessment 
transcript at the 80^ level, please read the following comments. 

An 80^ level of accuracy in coding questions in written transcripts- 
is required as an exit competency for this component of the module. 
Before coding this secon^i transcript, you should be certain thafyou 
understood the categories you miss-ed in coding the previous trans- 
cript. This may require that you work through certain portions of 
the <rritten program again. If you wish to do so, or feel that this 
is necessary, the eleven basic categories and the appropriate 
sections in the witt'en program are listed below, y 
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C After you have reviewed the question cat'egory classification system 
to your satisfaction, please code the following transcript which was 
taken from an advanced biology class. Students are in the 10th, 11th, 
and 12th grades with the majority of . thera being seniors. They have 
all had a year of biolpgy and most of them have' had chemistry well. 



T: That's an interesting question Robert. Let's see if anyone can 
. answer it, 

(a) Leslie what do you think? 
SI: Uh. , .1 did't hear what he said, 
T: (b) Robert? 

S2: I said what's the .difference between instinctive behavior and 

conscious* behavior? 
SI: Oh, well. .4^. An instinct is something that you do naturally. 
T: (c) Is thinking natural? 
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SI: (LONG PAUSE) Yeah, J gueoq it is* What I meant wac that an 

instinct io comet hing you can do without having to thiq|i about 
, it. . fLike when something comes at your eyes, you blinlc. 
That's an instinct, 
S3: Naw, man, that's a reflex action, 

T: (d) V/hat's the difference between a reflex action and an 
instinct, James? 

S3: A reflex action is something that Tiappqnq automatically, (LONG 
PAUSE). Like if somebody pokes at your eye, your brain doesn't 
have to think about it to malce your eyes close. The nerves that 
cause your eyes to close are attached more or less directly 
to the nerve that eJense when somehin' is fixin' to hit you in 
the. eye and it closes automatically. (LONG PAUSE) 

T: All right, that's a pretty good explanation of a reflex action 
and how it works, but (3) how is that different from an in- 
stinct? / 

S3: (LONG PAUSE) An instinct has to go t^hrough^ your brain? (LONG 
PAUSE) 

Sh: People don't have instincts I 
S3; How do you know? ^ , 

SU: People have reflex actions but they do evprything else con- 
sciously (LONG PAUSE) 
* T: You're saying that humans don't act instinctively at all. (f) 
Is that right. Pom? * 

Bh: Uh-huh. 

T: V/ell, (g) what is an instinct? Tell us what you mean when you 
say "instinct." 

Sk: ' An instinct is a long» series of actions that an animal does in a 
certain situation and every member of that species does exactly 
the sam6 series of actions in the some situation. (LONG PAUSE) 
I can't think of an exeunple right now. 

S5: When a dog rolls' over at the end of a fight when he'd been 
v^hipped, that's an instinct. • 

T; All right, Billy I^y, that's^a pretty good exaqigl^ (h) V/hy tio 
you thxrtk that is an instinctive action? . ' 

S5: Well, I got a bunch of dogs — ^^in fact, my daddy raisep dogs foi* 
a livin' — and every time there's- a fight between two 'dogs, the 
one that gets whipped rolls over on his back when he's re^dy 
to give up. Even the young dogs do it, the ones who have ,never 
been in a fight before. . ^And they all do it the same way too. 
They, all look the same. And it's the spjne way for pointer^ as 
it is for German Shepherds and Labs. 

T: That certainly fits Pom's definition of an instinct all right 

(i) Sherman, did you raise your hand? ^ 
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S6:. Yeo'm (PAUSE) I Juot wantea to oay that I don't think that'o 
an inotinct. Thooe dogo know li:iey been whipped and they juot 
; lettin' the other dog know it go that won't get hurt no more. 
That ain't no inotinct; that 'a juct good aenoe. 
S5: How come they all roll over the otme way every time, turkey? 
S6: They Oeen other dogD do it that way ' fore thev ever .got in a 

fight themoelveD, chumpl 
T:. Sherman, Billy Ray, don't call people nomeo in my room. You . 
both know better than that. (PAUSE) (j) How could you tell 
'whether that rolling over behavior waa inotirietive like Billy 
Ray Gayo or learned like Sherman oayD, Leo? 
ST: .That'o easy, Juot raise come puppieo by themnelveo do they 
. " ain't never oeen no other dog fight. Then let 'em get in a 
. fight with another dog* If all the dogs raioed by themselveo 
turn over the Dome way that Billy Ray'o dogo do, then it'o 
^an instinct. If they don't, then Sherman's right and they 
have to learn, how to do it by watching other dogs. 
T: (k) Do you think that's a fair way to test it, Billy Ray? 
S5: Uh-huh, that's O.K. 
T: (l) Sherman? 
S6: Yeah, that'o fair. 

T: (m). How Tong would it take to do that, Billy Ray? 

S5: Bout^'a year.a)efore they'd get big enough to fight. (PAUS?) 
But I'm gonna try it. I'll tell you ndxt year. 

T: That woulg, Imake a real good science project. Be sure to keep 
careful notes on everything you do so you can write your 
experiment up. (PAUSE) -All ri^ht^ ]pt»s get back to this 
definiti0tf of instinct that Pom gave a minute ago. (n) Can 
anybody fhink of an example of instinctive behavior? Mary? 

S8:^ I'm not;^ure about this but wouldn't birds building nests be 
an exanAle? (PAUSE) I mean, all sparrows build nests Just ^ 
alike. ^And ^11 bluejays build nests Just alike. But 
sparrowl* nests aren't like bluejay nests. (PAUSE) Like, uh, 
well, each kind of bird builds its special kind of nest by 
instinct. ^ 

S6: All sparrow nests ain't exactly .alike either. 

S5: Yeah but they'rka lot more like other sparrow nests than 
^ tbey^are like'bMeJay nests. You Just too dumb to catch on. 

T:^ BILm" RAY!! (l)^^uld you like to spend the rest of the period 
in the storerooiilj^ 

S5: No Ma 'sun. 

T: Then I don't wantV^i;|| hear you talking like that again. 
S6: Yeah, 'chtonp! 

T: That goes for you too Sherman (PAUSE) Sherniiiii did bring lip an 
intere'sting point. Pam, you said that every animal in a 
certain species would perform , exactly the same series off 
actions under certain conditions and Billy Ray mentioned that 
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all hio fighting dogo' rolled over in exactly the QmiQ way, 
- (p) Do. you wioh to maintain your definition ao Id or would 
you like to change it a little? 
SU: V/ell, maybe I ohould have oaid a whole lot alike inotead of 
exactly alike. 

T: O.K. (q) Sherman, would you be willing to oay bird neot 

building io inctinctive if we redefined Inotinctlve ao acting 
a lot alike instead of exactly alike? 

S6: Yeah, I gueso oo. , c 

Sf: And 1 never did oay thooe dogo turned over exactly alike. Juot 
that they did it the oame way. 

T: All right, l/e ceem to h^k a definition everybody cap agree on 
and a couple of really fine examplen for instinctn go. . .(r) 
Gherman? Did you want' to cay comething? 

S6: How do you know birds don't learn how to build necto? I meart, 
they're rained in neot'i] just like they one they end up 
building, ain't they? How do you know their mama don't teach 
'em about neot building? 

T: Another good question, Sherman. Socraten would have loved you. 
(g) Mary would you answer that question? Ho^ could you deter- 
mine whether or not neat building behavior in birds is instinc- 
tive or learned? 

G8: Could ypu take the eggs out of the nests before they hatched ^ • 
and hatch them in one of those things they use to hatch 
chickens? Then \ihen they grow up, let 'em go and see what kind 
of nest they build? (PAUSE) If the'y learned abou^ nest building 
from the mother, they wouldn't even kftow how to. build a nest 
would they? 

T: O.K. (5) How does that sound to you Deedee? Would you do the 

experiment like that or would you want to change something? 
S9: I don't Tike it. It would be too hard to follow the birds 

around after you let 'em g6. how would you fpllow them around? 
« (pause) I mean, it's a really good Qxperiment eXcept that it 

V70uld be too hard to follow the birds around once you let 'em 
' loose. If there was a way to do that, it Kould be a good 
experiment. 

T: -All right,. We've got to figure out some way to* follow th(/ birds 
around so we can see what they do. (u) Vlhat are some other 
problems i:ith Mary's experimental design. Randy? 

SIO: How are you going to keep the baby birds aliVe? I've tried 
to raise baby bir^ before and all but one of them died. And 
I've been real careful too. I^'ve kept them warm and^ given them 
mash4?d bug^ and worms with a medic\ine dropper and fed 'em orange 
Juice with vitan^ins and stuff in it. 

\ 
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T: (v) Wlmt did you differoatly for the dno ,that livod? 

GIO: nothing that I know of, ho wao juot tougher than the othoro. 

T: (hJ Then what would you rGQominGnd for the GxporimGnt oincG you 
avQ our^ rGoidont expert on baby bird raioinc- 

010: You'd'better otart with a lot of baby birdo if you want very 
many to live to build nepto becauoe moot of them arc gonna die 
while they're babieo. 

T; All right, according to Randy, we ohould hatch a large number of 
eggo in order to gef^ large enough number of birdo to live to 
the neot building otage. (x) Can you think 6f another prob« 
lorn witi'jythG experimental de/jign, Suoan? 

Sll: If they learn neot building from thoir mama, it OGcmo liko 
thGy could olco iGarn noot building from othor birdo too. If 
you let them go wild they could contact other birdo who had 
learned to build neoto and get what to do from thorn. Or they 
could Juot oboerve the neoto of other birdo in the wild and 
figure out how to build their ovn n^^oto. (PAUSE) I mean you 
can't be oure that they didn't learn their neot building 
behavior if you Juot let them loooe. 

S7: That'o |aoy to take care of. . .Juot build 'em a 'great big cage 
with oorae omall treeo and otuff inoide^it. That ought to oolve 
Deedee'o problem too becauoe if they w(}re in eagec you wouldn't 
have any trouble keeping up with them. 

T: (y) How big would a cage like that have to be? 

MSG CONFUBION WITH NO ONE AIISWER UNDERSTANDABLE. THEY ALL ANSVIER 

SIMULTANEOUSLY 

T: ' Randy, you ceem to be the reoident ornithologiot (z) How big. 
ohould it be for, oay, Englioh oparrowo? 



After coding this tranocript, pleaoe turn to page ten of the KEY 
BOOKLET to check ^our anowera, . • 
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(a) No Codo — Thlo queotlon io followod ImmGdlatGly by another 

quGotion. The otudont choooeo to anowor the oucond queotion 
and the firot quootion Id not a 1, qo it ohouM not be eodod. 

(b) 2A — Roeall of doflnltion 

(g) No Code — Do not oodo queotiona that arc aokod by otudont o, 

only thooG aokod by tQachoro. • 

(d) 2A — Thin io a repeat ht quGOtlon-(b) and lo eodod oimilarXy. 

(e) 2A — Anoworo to 2A quootionc are not really open for evalua- 

tion oinee the ''yeo" or "no" io eleariy right or Vrong. 
Therefore, aoki^ng a otudent to agree or dioagree with the 
anover to a 2A queotion io really aoking that otudent to 
anower the oomo queotion, 

(f) Uo eode — See explanation for queotion (a) above • 

Cg) Other "-*ThG teaqher io requeoting hypotheaio formation, 
^ therefore thio queotion would be coded ao a Uc. A cluo that 
they have not otudied the anower to thio queotion io the long 
client period. Uoually if an anower hao been previouoly ^ 
otudiQ^^, ^at leant one' otudent will have either learned the 
anower or will -know where to look. the anower up in tho.^ text 
or noteo. 

(h) Other — Hypotheoio formation' queotiono are coded ao Hc. 

(i) Other - " " " " UC. 

(j) No Code — .Only teacher quectiono ohould be coded when uping 
thio queotion catego3ry claoaif ication byctem. 

(k) 1 — Thio a command expreooed in interrogative form. 

(1) Other — The teacher *d otrategy io a bit unclear here but you 
have to aos\\Tne that he wao oeeking an anower rather than 
attempting to put the otudent on the opot. Had Eric 
anowerod the queotion, hio anower would have certainly 
been accepted. Code thic Uc. ' 

(m) Other — Since the- teacher waited for an anower to the queotion, 
thin ohould probably not be coded an a 1. The otudent io 
being aoked to actually evaluate hio behavior oo thto io ^ 
coded 5A. , 

(n) Other — Same >as above, 5A. 

•(o) Other — Queotiono which elicit hypothesis formation are coded 
l4C. 

If you miscoded more than 3 questions, please check the explanations 
^given above with the questions as they occur in the transcript • 
Then continue working thi^ough the progr(CN[i by turning to page 20. 

If you missed three or fe\>rer question codes, turn to page ?9 in the 
written program. 
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(a)' Other — Aoouihg that the teacher will accept whatever It lo 

that Irving knowo} code thio hh a completely open quootion. 
CbT Other — The category oyatem doeon't cover thio type of queo- 
' tion 00 it ohould he coded with a "o", ^ 

(c) gA ^ ■ ' si 

(d) ^ - - 

(e) 2A ' ^ 

(f) 2A 

(g) Oth(3r ~ oince the teacher aoked for, "a meaoure" rather than 

"THE meaoure," thio io an open queotion and io coded UA. 

(h) No Code ™ Only teacher queotiono are coded in thio oyo-^em. 

(i) 2A 

(J) 2A Although thio io an Qgree/dioagree queotiono, it refero 
to the anower for a memory-recall queotion and io coded 2A, 

(k) Other a eampletely open queotion with many acceptable 
anower oi UA. 

(1) Other — an open queotion: Ua 

(m) 2A — Thio could aloo he a 3A queotion in context oince the 
otudent could be uoing a given or learned oequence of 
reaooning to produce the correct anower. However, in the ' 
context of thio iQooon and especially with the context of 
thio otudent 'o proviouoly facile anowero, the queotion io 
probably memory-recall. 

(n) 3A — Student io being aoked to produce a right anower uoing a 
learned oequenee of reaooning. 

(o) 1 
(p) 1 

(q) 3A — • producing right answer with, learned or given reaooning 
oequence. 

(r) 2A 
(o) 3A 

(t) 1 — teacher dnowered her own quei3tioji, do thio io rhetorical 
(u) 3A , 

If you have recoded this transcript, ao per d'^ections on page 83, 
turn to p. 82 in you missed any of the hk questions. If you properly 
coded the hk questions, turn to pi Bh in' the. written program, 

r 

If you have coded this transcript for the 'first time as per direc- 
tions on p. h2 of the written program, count* your misses, If you 
miscoded more than h questions, review the category definitions for 
the type of question you missed (l, 2A, 2B) 3A, ancl eother) and then 
compare the explanations given above with the transcript which begins 
on p. ^0 of the written program. ^ 

If you miscoded ^4 or fewer questions, turn immediately to p. ^43 of 
the written* program. • v 
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(a) 3B -«'ADking for an Infereneo from data 

(b) 3B ~ " 

(e) Ho Co^e^— =- catepioriae^ only tcaeher quoDtiono' 

(d) Other QuGDtionD roqucoting Gxperlraontal dcaign arc coded qo 

(q^) Other Ginee either of the variableo would he aeeeptable, thio 
Id an open qUeotion: Ua, 

(f ) 1 ~ A context clue that thio Id a procedural queotion in the 

teacher aoking the entire claoo rather than a opocific 
per Don. 

(g) 3A ^- the otudent'o onower io sufficient context to, indicate 

that they have learned a oet pr9cedure for anowerins thio 
queotion. ^ 

(h) 3A ~ Dorne ao above. 

(1) 3A In context, thio io a 3A but -you don't hear the otudont 
anower pron^-iding the context clue until much later. If you 
coded thio ao "other" {UA - completely open queotion), don't 
count thio ao a mloo. 

(j) 3A There io only one right anow^j?- to the anower being 

evaluated, oo the agree and dioagree options^ are not equally 
acceptable. Thio io juot aoking the oome queotion again in 
different form. 

(k) 3B — . Student aoked to provide reaoono for giving a previouo 
anower . 

(l) 3B — Aoking for an inference from data, 
(m) 3B.~ n n ^ H ^ H , 

in) Other — Queotiono eliciting hypotheoio formation .are coded hO. 
(l)* Other Queotiono eliciting experimental deoign are coded UB. 

If you miooed U or more queotiono, please review the categorieo With 
which you had trouble, by rereading the short diacuooion in the 
introduction booklet. If necessary, review the appropriate section 
of the vrritten program (l— p. 3; 2A - p. lU; 2B - p. 19; 3A - p. 30; 
3B - p.U3). After reviewing the categorieo you missed, close the 
key booklet and recede the transcript beginning on p. 6^" of the 
written program. 

If you missed 3 or fewer questions, please turn to page sixty-five 
in the written program. ' . ' 
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(q) 1 manaCGrial; teacher io aoking for o> vdlunteer 

lb) 2A mckoVy-reeall (that they have otudleci thio io obviouo 

from their anoworo) 

(e) Other — Open queotlon with many aoeeptable anower; hh 

(d) gA a rccQcnition queotion 

(e) 2A . . 

if) 1 • ^ 9 

(|t) gA — another recognition queotion: oee^it and name it 

(h) 2A • . 

(i) 2B — Dimple oboervation 

(j) 3B ™ otudent aoked to eite reaooning behind previouo anoirer, 

(10 PA ^ ^ ' , ^ / 

(l) 3B — - prediction from oufficient experiential baoe (aooumo th&t 

ninth gradero have oeen balloono blown up, even if not in-^ 
^ ocienee^claon) 
(m) 1 " The teachef io expecting agreement. Thio beeomeo quite clear • 

'when-^one of the otudento dioagreet]. 
(n) 3B ~ Student aoked to cite reaoono for a previouo ao,G<?rtion 
(o) 3B — Aoking for a prediction with oufficient data, 
(p) 2Bi — Although thio may oound ao if the teacher io r-equooting 

a hypotheoio, the otudent ^o anower and the next queotion ^ 

and annwerprovide oufficient context for coding thio ao ?^B. 
(q) 2B " Gimple oboervation, Juot like the previouo queotion, though • 

it ooundo comewhat ao if the teacher io requeoting hypotheoio 

formation. 

(r) 1 — The teacher expecto agreement. Thio could have been coded 
an' a 3B queotion had the teacher worded the queotion a bit 
differently. It wao not coded ao a 3B irLthio caoe becauoe 
the teacher told the otudent what he wao predicting, 

(o) Other — V/hile one io oafe in aoouming that ninth gradero have 

• oboerved balloono being blown up,^ one io probably not oafe 

in aoGuraings-Ahat they have oeen this done at varying tempera- 
tureo or that they have oeen the temperature of a balloon 
varied. Since it io fairly' obviouo from context that they 
have not diocuooed the phenomenon ip claoc and it io aloo 
obviouo that the teQ,cher io accepting several differing pro- 
dictions, thio queotion would be coded ao a 413 —a divergent- 
production queotion which requeoto a logical prediction from 
an insufficient data baoe. 

(t) hB — same as above. 

(u) hB — Even though only the otudent 'n name io used, it io 

obviouo that the oome question io being aoked \^hen j)ne hearo 
the anower. Had the otudent not responded to the question 
but ill oome unrelated manner, one could be Juctified in 
coding this as a 1.^ 
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(v), 2D — Rc'quoot for an obocrvatlon 

(w) 3C-«« One of the tradomarko of 3C quootlono io that they are > 
vovy difficult to phr^aoG properly and a tGaehor often muot 
try oeveral timea at phraolnctho queotion before he or Dhe 
lo certain that the otudent underotando eKaetly what it io 
that Id being aoked. V/hat ohe wanto him to do lo mentally 
eheeU out the eemparloon phenomenon ho eited (i.e., the 



bicycle pump'o heating up) and to figure out (l) why it did 
not apply ao he thought it. would; and (2) how he could explain 
what are, to hlra, diocrepant event o. Again, in conteKt, it 
lo obviouo that the teacher io not; oeeliing a "right" janower 
which lo why thio queotion lo coded ao 3C inotoad ©flUC. 



If you mloood 5 or mgre queotion ^codlngo , pleaoe keep the key booklet 
open and turn to page 7? of the written program. Corapare your coding 
arid the explanation in the key to the tranccrlpt. If you are otlll 
unoure of the coding of a opecifie queotion, reread the dlocuoolon 
of the two categorleo in the introduction booklet and rework the 
appropriate oectiono In the written program (l - p. 3; 2A - p. l^M 
?,B - p. 19; 3A - p. 30; 3B - p. 3C « p. 66). After doing thio 
to your oatiofactlon, clooe the key booklet and recode the tran° 
Dcript beginning on page 72 In the written progrcjm. 



If you have mioned four or fewer, congratulat i(;nn on your burgeoning 
expert ioe. Pleao^? turn to page oeventy-olx of the written program. 
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(1) 3B — asking student to cite reasons 

(2) 1 , V - ^ 

'(3) 1 (if you hav^ Ub here, or '"other", you may have coded an ^ 

un-numbpred' question) 

(U) Other — This requests a prediction from inadequate dat^a; hB 
t5) — same as above. ' 

(6) 2A ' 

(7) 

(8) 1 

(9) 1+B — same as above {h and 5). This could have also been a 1 

had Ronni^js answer 'indicated that the q^uestion vere mana- 
gerial in context. 

You should have missed 2 or fewer. If you correctly coded the un- 
niambered question as a UB, give yourself a brownie point. If you- ^ 
coded question (9) as a 1 rather than -^a UB, do not count a miss 
since it is really context dependent and you did not have the con- 
text (If you coded it as -anything except' a 1 or te, count it as a 
miss). ' If , after considering these exceptions, you still missed 3 
or more, review the question categories you mifssed by -reading the 
introduction booklet and reviewing the written program (l - p, 3; 
2A - p.lhi 2B - p 19; 3A - t>. 30; 3B - p. ii3; 3C - p. 66; hA - p76; ' 
hB - p. 8I4; he - p. 93). After you are satisfied l^hat ybu understand 
your missed codes, please turn to page 113 in the written program. 

If you missed two or 'fewer questions, please turn to page 113 in the ^ 
written program.^ 
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(a) 5A 
M 5A 



(c) ^ 

(d) 3^ 

(e) 3B 

(f) 5A 
"(g) 1 - 



3 



(h) 5A 



— asking for reasoning to support the previous answer 

— same as above * • ^ 

— This is definitely a procedural question. i)Had Carl answered 
"No," the teacher would probably have handled this quite 
differently. * ^ ✓ * 



If you missed 2 or more questions, please review the categories you 
missed. This means reviewing the false .positives as well as the 
negatives (e.g., if you coded a 5A question as Uc, you should review 
both 5A^.and hc questions). If necessary, work through the appropriaH:e 
seqtiCns of the written program. The pageq for each category are 
listed below: 



V 



1 - p. 3 




t 


2A, - p. lU 


! 


V 


2B - p. 19 






3A - p. 30 






3B - p> U3 ■ 




•V 


3C - p. 66 






Ua - p. 76 




. 1 


Ub - p. SU ^ 






he - p. 93 






5A - p. 113 






5B - p." 118 







If you missed only one^ qu'estion, re-read the question in^context ahd 
compare it tg the- coding given above. After you have justified the 
above coding to yourself satisfactorily, turn to page ll8 of the 
written pi^ogram. 



If you didn't miss any codes at all, please turn directly to p. Il8 
of the written program. The end is in si^t. 
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(1) 2B — simple observation 

(2) 2B 

(3) 2B 

(U) No code — code only teacher questions 

(5) 1 

(6) 1 , 

(,7) No code — teacher questions only with this question classifi- 
cation system. 

(8) 2B — Asking student to "translate" what was said into other 

w^rds 

(9) . Ub — experimenta/1 design question ^ 

(10) 1 " , ' ^ 

(11) hB experimental design question 

(12) 3B — asking for reasons to support assertiofi 

(13) '30 — asking* student to analyze a hypoibhesis and to find an 

observation that supports it. 
{ih) 3C — repeat of above question 

(15) 1 — teacher asked student to confirm knowledge of a defini- 

tion, not to cite the definition itself. Had the teacher 
requested the student to give the definition, this would be 
2A 

(16) 3C — same as questions (l3 and ih) . ' 
(IT.) 5A 

(18) UB — ' experimental design 

(19) ^ ^ . 

(20) 3B** — asking for reasoning to support an answer 

(21) ' 'Ua — open question with many possible answers 

(22) hk , ' ^ 

(23) 2A — student is expected to remember a fellow student's 

response * 
(2I4) kA . . . " 

(25) hk ^ ^ ; ^ 

(26) hB — experimental design 

(27) 1 

(28) 1 ' . • 

(29) 0 — this might legitimately be coded as hB except the student's 

answer never makes clear exactly what was being asked. Had 
the student responded with a suggestion for the next step in 
the procedure, this would have" been a hB. Poor phrasing makes 
interpretation of the question impossible, given no clear 
context cl^e such as a student answer. 

(30) 0 — This question does not fit very cgmfortably ' into any of the 

categories. It might be coded 1 with clearer dontext defini- 
tion. V ^ 

(31) 1 
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(32) 
(33! 
(3h: 

(35; 

(36; 

(3t: 
(38; 

(39: 
iko] 

(hi: 

{h2] 
{h3] 
ihh] 
(h5] 
ihS] 

(ut: 

ihB] 

(50) 
(51: 
(52; 
(53! 

(55) 

(56) 

(5t: 
(56; 
(59; 
(60; 
(61: 

(62) 
(63) 
\Sh: 

(65: 
(66) 

(6t; 



(68) 

(69) 
(TO) 

(71) 
(72) 



asking for reasons 

asking for hypothesis formation 



2B 
3B 

o — Again this doesn't fit easily into any category and • one 
, might be tempted to code it as a- 1. 
30 — same reasonj.ng as for (l3 and l^t) ' 
30 ■ ■ ' 

3B 
he 
1 

hB — experimental design 
ItB 

UB . - - 

1 . ■ 

1 

2^ 

" 2B • ■ 

2B — student asked to translate "it" into language vmderstood 
by other - ' 

" 1 ' - . 

■2A- 
2A 

hA . ■ - 

hk 

hA - 
5A 
he 
5A 
3B 
o 
' 30 

30 • ■ . • 

30 

1 • • 

no code -'^ student questions axe not coded 

he — The student answers the latter of two questions so only 
the latter question is coded. 
he — hypothesis formation 
1 — In the context of Liar's following question, it's clear 
that the second question "Lamar?" is procedural. Lamar had 
his hand up and is asking for permission to speak which is 
given. 

ItB — experimental design 
1 

2B 

3B ' 

1 — This is rhetorical. The teacher answers it himself. 



\ 



-j| hypothesis formation 



— same as 13, 1^, 351 36 
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1 



If you miscoded 13 or more questions , please reread the transcript 
checking it against the key to clear up any misvtrlderstandines . If 
necessary, review any categories of which you are still unsure. ,Then 
close the key booklet and re-code the transcript you just finished. 
V/hen you have coded this transcript with fewer than 15 misses not 
using the key, t\a*n to the second transcript in the "written program 
exit assessment" and follow the directions. 

If you missed -fewer than 15 questions, proceed immediately' to the 
audxotaped component of the module. Be sure to read the directions*"' 
for coding audiotapes before beginning the audiotape component. 
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Mr 


(a) 


O - 


(b) 


0 


(c) 


5A 


(d) 


2A 




PA 


(f) 


1 


(g) 


2A 


(h) 


3B 


(1) 


1 




kB 


11:) 


5A 


11) 


5A 


|m) 


3B 


In) 


Ua 


/(o) 


1 


(p) 


1 - 


(q) 


1 - 



(r 
(g 
(t 



(u 
(v 
(w; 
(x 
(y 

(z 



learned definitionc f9r inctinct and reflex action 




peri- 



"no" a different kind of 



ence witlf do^s; 



implied. 
— managerial; if Sherman sayo 
queotion will follow. Again the desired andwer is implied 
by the teacher* , 
1 ^ * 

Ub — experimental deolgn ' 

This is really two questions and the student answers them both, 
which makes it really difficult for coding. The first question 
io fcoded as 5A and the second is coded as UB« 
— {analysis question wij^h several possible answers • 



2A — memory-recall 
Ub — experimental design 

lie 

l+B 



— '^a'halysis question with, several possible answers 
~ experii[aental design 



If you missed more than five of the questions alcove, you may not have 
followed directions in the written program as carefully as you could 
have. If you have been turning pages be/ore writing down you cate- 
gorization of example questions and transcripts and/or if you have 
advanced to new sections before reaching the reqommended criterion 
levels for previous sections, ^ou sliould repeat the written program 
and follow the directions very carefully/ 
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If you have faithfully followed the directionD and hove otill not 
achieved the 80p accuracy level for coding written 'tranDcripto, 
there lo a communication problem; Try to determine which category. " 
or categories we disagree on and determine what key words seem to be 
problems. It's quite possible that you disagree with the nature of 
the category system and ore subconsciously using what you think it 
should be rather than what it is. If this is the case, try to use 
the category definitions even if you don't agree with them. If you 
wish to spend time writing suggestions, comments, recommended revi- 
sions and so /orth, we would greatly appreciate yoxir giving these to 
us so they could be used to restructure the module. It's also , 
possible ,that certain key words have different connotations for you. 
If this is the case, try substituting synonyms which make sense to 
you in the context of the given example^s and c3ded transcript. After 
doing this, recode the two transcripts 'in the written program exit 
assessment. 

If you have missed five or fewer, you are ready to proceed to the 
^udiotaped component of the module. Be sure to read the directions 
before ISeginning this component. 
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X 


000-010 


4 


2B 


010-020 


(obcervation queotion; 


2B 


020-030 


( M " ) 


X 


030-01*0 




3B 


01*0-050 


Asking for reaaono 


!»B 


050-100 


experimental decign 


3B 


100-110 


acking for reacono-what do you expect to find out? 


X 


110-120 


Why did you chooDQ that decign? 


X 


120-130 




hi 


130-11*0 


prediction from an inadequate data baoe 


5A 


ll»0-150 


simple agree/diaagree evaluation of previouG prediction 


X 


150-200 





Did you micG more than two quest iono? If you did, don't feel bad — 
coding audiotapes is infinitely more difficult than coding tran- 
Dcripto. Rewind the tape and try again after closing the key booklet. 
Be sure to concentrate on the dialogue, excluding all extrai^uo 
factToro from your attention. 

If you micsed two or fewer, you ore now an ^pert coder. A 10% 
accuracy level is a very high level of skill for coding audiotaped 
episodes. Please start the tape and proceed with t^he audiotaped 
component of the module. 
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UA 000-010 open queotion with many poooible ancvrero 

1 010-020 procedixral "V/ho usee volume?" 

1,0 020-030 Firct queotion is procedural. Second unintelligible 

2A 030-QUo memory-recall 

UA OUO-050 another completely open question 

X 050-100 

X 100-110 

Q 110-120 unintelligible 

2B,2A 120-130 Firot is tranolation type ("V/hat do you mean by. . .?) 

X 130-1^0 and the second ig memory-recall) 

X 1U0^150 

X 150-200 ' / 

A comment not directly related to the subject of clacnifying questions 
in Dcience clasoeo: The studentis interrupt the teacher while he ia 
^alking — but he does the same thing to them. Do you hear your stu- 
dfents interrupting you? If oo, listen to your tapes to see if you - . 
interrupt them too. Except for this, the lesson is a good example 
of teaching in which the teacher relates the subjqpt matter to' the 
every-day out-of-school lif6 of his students. 

If you managed to'' hear all the inaudible unintelligible questions, 
there are 10 possible questions with correct coding on at least 
seven of them the criterion level. If you did not hear some of the 
"o" questions, calculate 1;he number of questions you coded x O.f^ 
gives the number of questions you should have coded correctly). If 
you coded the episode at below the 10% level of accxiracy, please 
rewind the tape and attempt to resolve any coding discrepancies by 
listening to the episode with key in hand. Then code the ne?;^t, and 
final, episode. 

If yoii "successfully coded this episode at or above the 10% level of 
accuracy start the tape and code the next, and final, episode. 
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000-010 


2B 


010-020 


X 


020-030 


2B 


030-01*0 




OI4O-O5O 


1,2B 


050-100 


X 


100-110 


X 


110-120 


1 , 3B 


120-1.10 


2B,2B, 


"130-luo 




luo-150 


M 


150-200 


X 


200-210 


X 


210-220 


X 


220-230 


1 


23O-2U0 


kc 


2UO-25O 


1, he 


250-300 



1 


300-310 


X 


310-320 


X 


320-330 


he 


330-3l»0 


X 


3UO-35O 


X 


350-Uoo 


Xi 


1*00- 1*10 


X 


1»10-U20 




Ii20-U30 




1»30-I)lt0 


X 


kkO-k'jO 


1 


1*50-500 


1 


500-510 


1' 


510-520 



t 

VJhen khe teacher recorded thic leaoon, she left both the air condi- 
tioner and the aquarium p\imp on, which explains the roar in be back- 
ground. You can hear her fairly well despite thir, interference 
because the microphone io Get up very close to her, 

A very nice strategy which you may not have noticed (arid which in not 
directly connected to the subject of this module!) is the teacher^n 
interaction with Gina. Gina was asked to propone a hypothesis and had 
some trouble in doing so. A couple of minutes later, vhen another 
student gave a good answer, the teacher drew Gina back into the 
answering process with two procedural- questions by asking her to share 
an evaluation of the answ^ with the teacher ("Gina, does that make 
ser^se to you?" and "it's a good idea, isn*t it?") 

SIX is the magic number ^ this time. If you missed more than six you 
should probably review the introduction booklet sections on 2B and hc 
questions before you rewind the tape,^ close the key booklet and recode 
this episode. 

If you missed six or fewer, you are still coding at the 10% level or 
better — quite a feat. Please start the tape and code the next 
episode with equal facility. 
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1 


000-010 


The teacher Implieo an answer of "yeo" to thia question. 


1»A 


010-020 


An open queotlon ao evidenced by student answer 


X 


020-030 




X 


030- OUO 


• 


X 


0)»0-050 






050-100 


Uoe of vordo like ''potential*' and ''kinetic" Indicate \ 


2B 


100-110 


Tranclation prior otudy. 


2A 


i;o-i20 




X 


120-130 




X V 


130-lHO 




2A 


lUO-150 




X 


, 150-200 


« 


X 


200-210 


Another tronolation queotlon (VJhat do you moan by 


2B 


210-220 


X 


220-230 " 


that? — i.e. please rephrase that in other words 


X 


23O-2UO 


00 we con understand) 




2UO-25O 





Quality recordings Just can't be made in some classrooms because, of 
the acoustical design and this is one such classroom. You can, ho\/- 
ever, understand what he says if you pay careful attention. 

Only eight questions were asked during this short episode and you 
should have coded at least six of them correctly to maintain a 10% 
accuracy level. As mentioned above, context clues indicate that the 
kids have studied energy and heat prior to this lesson, making many 
of the questions memory-recall and translation type questions (2A 
and 2B). Please start the tape and code the next short episode. 
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noo-oi 0 

vywvy V/ J. w 


V 
Jx 


300-310 






V 


310-320 


It 


w c w w J \y 


,,.„ liP ,« 


^20-330 






X 


330-3^0 


J>iV 






3U0^350 




"n^o-i no 


V 


350-'*00 




1 00-1 1 0 


V 




X 
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Another valuable leocon about coding audlotaped leooonG-io that it 
helpr. to have a high quality recording. Unfortunately, the quality 
of thin recording ic typical of the recordingc many teachei":] make for 
a variety of reaoona, not .all of which are un^^r the control of the 
teacher . 

Like many ^teachero, the teacher you Juot heard pacea hio lecGon a 
bit too faol and interrupts hio ntudento while they are talking. 
TheDe are the mirror flaws in what deemo to be an otherwioe excellent • 
teach. 

If you miscoded MORE TMN 7 iiuentionn, you did not code thio eplnode 
'at the 70^ criterion level. If no and your missed coding was due to 
problems with hearing what was being said, rewind the tape and recode 
the epidose now that you are more familiar with the lesson. If you 
heard the questions but are unsure of Gome category assignments in the 
key, rewind the tape, study the introduction booklet for those cate- 
gories you missed, and. listen to the episode with key in hand to 
resolve the discrepancy. 

If you missed 7 or fewer questions, read the note below and then 
start the tape to code the next episode. 

NOTE: Inadvertently, the page of the key booklet corresponding to 
the next, episode was omitted from the audiotaped commentary x^hich 
aclompanieG each episode. The proper key booklet page for the next 
eaPl^de is 19 . Do not turn to that page until AFTER you have coded 
the next episode. 

148 ' 



29h 















PA " 




J. j JL 


nil n—n^in 


PA 






1 100-110 




" 110-lgO 


2B 


" 120-130 


PA. 1 


' 130-lHo 


gA, ?JV 


' lUO-150 


2B 


' 150-200 


2Aj_l_ 


200-PlO 


X 


' ;?io-p?o 


X 


' P?0-?30 




230-2^0 (Even' though it later becomeo obviouo in context that 
21*0-250 he want to elicit a opecific anower, i.e., "evaporation" 

230-300 and "condenoation thio firot queotion ±n the oerieo 

2A, 2 A 300-310 ohould be coded hk oi^ce it io initially open, Liee 
codinf3 rtlle If. in the introduction booklet) 



Thio io a good review oeooion. Many of the queotiono are memory-recall 
with a few t^i-anolation type queotiono.and a few open queotiono thrown 
in to improve communication and build intereot. This teacher aloo 
uoeo rhetorical queotiono quite a bit. The pacing io rapid but 
probably not too rapid for the participating otudento oince it is 
fairly obviouo that they are keeping up with him. Many di^^erent 
otudento are afforded opportunitieo to anower queotiono. ^ 

If you miooed^mor^e than 8EVEN queotiono, you ohould review the coding 
ruleo in the introduction booklet. Thio epioode moved rather rapidly 
but the queotiono were otraightfor^mrd and the recording quality wan 
good oo any problemo you may have had in (?oding ohould have otemmed 
from not remembering the ruleo at the end of the introduction booklet. 
After reviewing' the decioion ruleo and any categories about which you 
otill have doubto, rewind the tape and recode thio epioode. 

If you miooed 7 or fewer queotiono, you ore coding at or above the 
TOp accuracy level. Thio io quite good. Keep up the ^good work 
when you otart the tape and code the next epioode. 
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The kidG are pretty noisy but the teacher r;eemr3 to accept the noioe 
with no problem. Gometimen the noine level during a l<;nr,on can get 
fairly, high if teaohern elicit ano^-xerr^ to a aerien of open quentionc, 
enpecially Jf they aren't accuntomed to open quentionn in their 
everyday ochool oituation (and remember that their everyday ochogl 
Gituation includen more than Junt your nCience claon). 

There are ^»1 quentionn aoked by the teacbor in the episode you junt 
analyzed. If you correctly categorized at least 29 of these quea- 
. tio^G, you have coded the eMbode at the 705? or better level or 
accuracy. If you have codeu the final epinode at the 70?5 or better^/ 
level of accuracy, you are nov ready to analyze your own teacher ^o 
determine what kindo of queotionn you aok. 

PLEASE TURN TO THE NEXT PAGE 
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Remember that the ideal model of teaching with questions that is 
stressed in this module is the use of many 'different types of * 
questions/ Because certain tyjjes of questions lend themselves' to 
certain objectives and cei^tain types of activities, you will not be 
fair to yourself if you examine only one example of your teaching.^ 
To obtain an accurate estimate of the types of -quest ioilPs you istsk, 
yotf should listefi to several short sar&ples of your teaching on difr 
ferent days — perhaps 5 minutes early in a lesson and 5 minutes a 
bit later in thp same lesson, repeating the procedure for . two or 
three lessons until you have analyzed 20-30^minutes of your teaching 
Since all eleven types of questions can relate to legitimate objec- 
tives of science teaching, you should^ find yourself using many of 
' thes« eleven t^es,.of questions. If you find yoursel:^ consistently 
using only a few types of questions in different lessons, perhaps' 
you shotUCd plan to use types of questions you (Jo not normally ask, 
including them fin 'future lessons for which questioning is an * 
appropriate strategy. 
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This series Of questions regarding the depth of the 
picture of the coke bottle are classified kB becsdise 
the students are being alloved to generate their ovn 
definitions of vhat. constitutes depth. Both yes and 
no ansver^ are being accepted by the teacher but the 
. students are not re^ly evaluating anything vhich 
eliminates 5A as a possible category classification- 



^Because it is possible to miscode the "Does this bottle have depth?" 
questions and miss five questions inmiediately,; that series of ques- 
tion^ should be counted as one question for the purpose of scoring 
joui^ coding accuracy. You should , howev^, have coded those questions 
with" the same designation whether or not you coded them correctly a^ 
kB questions; if you did not, you should try to be more consistent 
in your coding. 

Counting the- five "depth questions" as one question, there are 10 
questions and you should have coded 7 of them correctly to maintain- 
a 10% acciaracy level. If you missed more than three questions, or if 
you were not consistent in coding the "depth" "questions , please 
resolve the errors by re^mxz^^ to the introduction booklet if 
necessary. Then close the key booklet, rewind the tape and recode 
this episod^ 

If you missed three or fewer and especially if you co^d the kB series' 
accurately, congratulations. Please start the tape and listen to the 
remainder of side A. j 
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DIRECTIONS FOR CODING AUDIOTAPED, VIDEOTAPE!? AND/OR LIVE CLASSROOM ^ 
EPISODES FOR .THE TYPES OF QUESTIONS SCIENCE TEACHERS ASK. 

In order to get some^idea of pacing when coding classroom questions, 
Hse a stopwatch or a. watch or clock with a sweep second hand and code 
questions in ten second intervals, using code sheets similar to the 
attached code sheets. 

(l) If. a question 'is asked during the ten-second interva^., write the 
appropriate code on that interval line. For example, 

2B 3i+0-350 ^ 



(2) If ho question is asked during a particular ten second interval, 
make a check mark or an x on the interval line corresponding to that • 
interval. For example j 

^350-Uoo . r ^730-7^0 



(3) If more than X>ne question is asked during a certain ten second 
interval, code all questions asked, separating each code with a comma. 
For example, . ' ' 

. 000-010 



(U) If a teacher asks the same question several times in succession 
such as is common in using the eliciting strategy, use the full code 
designation for the first time the question *is asked and use ditto 
marks for each succeeding time that question is asked until a different 
question intervenes. For example. 



s 



hk 320-330 



hk 3 30-^3^0 

_^ ^3^+0-350 

350-i+OO 
"^Ii00-iil0 



[ It 

_2 sa. 



The teacher began this Sequence by asking an open question, then 
asked a different open question which was used three more times 
(Once it was used'^twice within a ten-second interval.) 

The pacing can "be a very important context clue for applying the 
decision rules found at the "back of the introduction boojtlet. For 
example, teacher often ask 2A and 2B questions at a little faster ^ 
question-answer pace than they ask the category 3, ^, and 5 questions.- 
For the purposes of analyzing the tapes of your own teaching or the 
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teaching of a colleague, the pacing is important for spotting patterns 
such as not allowingA sufficient time to think Up answers to 3B, 3C, Ub, 
^C, and 5B questions. 

On the^J)ack of this sheet is an example of a time-coded post-lah lesson 
with margin conmients to explain what was actually heing asked. In- 
coding lessonsV you would not normally include extensive notes, although 
space ^has heen provided on the code sheets for short notes. 
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.OOO-OIQ teacher is reviewing what )-itas , done during the experiment 
.010-020 



¥ the day "before / 



020-030 Acking for experimental data. This question - ic used ^ 
sy^' Geveral times »to elicit answers from different students 
030-0^40 * 



1^ 



.pilO-050 
.050-100 
.100-110 

.110-120 Inference type of question. V/hat would happen under simi- 
lar cir:9umstances? 

.120-130 

.130-lUC Request for clarification. V/ould you please rephrase 

your answer? / 
lUO-150 VThy do you think that would happen? V^at ore your rea- 
sons for making this prediction? 
150-200 Rephrases the question so that the desired respondent 
understands what is being asked. 

200-210 

210-220 Asfks a different student for another inference from data 
220-230 

230-2U0 Asks fojr another prediction not directly derivable from 
data 

2UO-25O ' 

5/154 250-300 Do you agree with that prediction? type of question direc 

Z)? three different students. On receiving a "NO" 

^ f\j^J7_ 300-310 response from the third student, teacher asks a 3B 

• question — Ifliy don't you think that will happen? 
*^ 310-320 

3^0-330 



3i 



3B 

I3l. 



33O-3U0 Experimental design question — How C9uld we tell the 

difference betweeri these two predictions? 
3UO735O Another experimental design question — tightening up 

^ details 
350-UoO . 

UoO-UlO More design question related to distinguishing v/hich of 

the two predictions is correct 
^10-U2p A student is asked to evaluate the design, given certain 

" \ criteria. 
U2OJ-U3O * ^ A r-r- 
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AUDIOTAPE GOMPbNEHT ^ 
SIDE A 

. The tape begino with Donald Bird's "Ethiopian Knighto/' 
a composition which begins with a fairly simple drum part, adds 
several rhytlun instrumentc one at a time until a quite complex 
rhythmic pattern is constructed from a number of much simpler 
parts. This occurs during a period of 3 minutes, l6 seconds 
at which time the music is faded' to a low volume leve^ and the 
commentator begins: 

By the time you hear this commentary, the music to which 
you have been listening haa become quite complex. Many simpler 
parts have been interwoven to produce a composition that 
is certainly more than ^the sum of its individual parts. Jf 
you were asked to described what was happening in the music 
to produce the effect, you would have to perform a careful 
analysis of it, focusing on the individual elements and 
patterj(s until you could adequately describe those elements 
and t>atterns , ' j 

But even if you focused on each part so that you could 
describe each in turn, you would have to answer NO to the 
question ~ IS IT THIS PART THAT MIOCS THE MIJSIC VHIAT IT 
IS? This is because, regardless of vrhich part is considered, 
the overall effect of the music is due to each individual 
part and to the way in which the parts are blended. 
- If someone asked you ~ COULD I REPRODUCE THE COMPOSITION 

BY REPRODUCING TH:^ BASIC PARTS? you would again have to ^ ^, 

answer NO because each part of this composition is a pattern 
around which «each instrumentalist improvises in relation 
to the improvisation of the other musicians. A group of 
musicians who had analyzed this music and discovered its 
basic patterns could produce a composition that was recog- 
nizable as the composition you are hearing but it would 
not be exactly the^ same piece of music because the individual 
personalities, creative abilities and musicianship of the 
individual improvisers would be reflected in their use of the 
basic elements and patterns \7hich comprise th^ composition. 

By now you are asking ~ V7HAT DOES A DISCUSSION OF MUSIC 
HAVE TO DO WITH TEACHING? VJell, teaching and Jazz are very 
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.similar in many wayo. Both are cupreme art formo at their 
higheot quality and both can be learned at oom^e level by 
almoot anhone who io willing to opend enough time- working 
at it, Thio Jazz compooltion and a lecoon conducted by"a 
good teacher are both complex vholeo made up of ceveral 
omaller patterno and elemento. The municlann or the teacher 
improvise on .the baoic patterno and elemento to produce a 
well- integrated complex whole which can be attended to by a 
peroon for enjoyment or for learning. Thoae attending need 
not be intelfectually aware of the elements and patterns 
which comprise the whole. The elements and patterns of either 
a teaching composition or a musical composition can be 
intellectually ilnderstood, analyzed and described i^f^ one 
is willing to fcitus on one element or pattern at a time 
the excluoion^f others which are equally important* 
This kind of focusing io important for the description of 
both jazz and teaching. 

A common teaching/learning technique foi^ musicians becoming 
Jazz artists is to focus on the elemento and patterno of 
performances by their peers and by acloiowledged masters and 
it is here thaVSj^he analogy brealcs down because this kind of 
activity io not common in teacher education. The audiotaped 
component of this module io designed to help you learn to 
analyze teaching for one important pattern — using diffe- 
rent kinds of questions. V/hen you have finished this module 
you should be able to analyze your teaching and the teaching 
of your colleagues to determine how patterno of questioning 
fit into improvised teaching compositions. 

The commentary required 2 minutes, 58 seconds and following 
it, the music is faded back up for 20 seconds. Then the first 
audiotaped protocols occur, sans background music. 

f 

TEACHER: Can you see how a graph might . . . might help you to . , 
. to uh . , . to, to see which would be more accurate and, 
and see how many people came out closer , . , than, rather 
than (unintelligible)? [12 seconds] 

1 second siler\ce 

TEACHER: Glen, do you know what a variable is? 
STUDENT: Yessir, I do, 

TEACHER: I was asking Glen. Thank you, though, Everett. Would 
you tell us please? [9 seconds] 
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1 second Gilence 

TEACHER: (Unintelligible) OK, go then if that's all they found, 

they<^ really don't know any more than you do, do they? 
CHORUS: Right! No I etc. etc. [9 seconds] 



At this point, the background music is faded in and the 
commentator continues: 



All the questions you Just heard would be placed in the 
same cfategory of the system you learned when you worked 
through the written programmed instruction, (PAUSE) V/hat • 
category would these questions be assigned to? "(PAUSE) 
Stop the tape and write your coding down. 
[ih seconds] 

Background music is faded up for 28 seconds, then faded back do\m 



as the cotnmentator says: 




These questions would be coded as category one. If you did 
not code them as belonging to the first category, please 
rewind the tape and listen to them again, 
[9 seconds] 

s 

Background music is faded up for 20 seconds. 

' <^ 

Throughout the audiotaped portion of the module you will 
be coding individual questions in classroom sequences of 
varying lengths, all of which have been derived from audio- 
' tapes m£^de in real classrooms. Since you would normally 
use written materials to aid you in any analysis of class- 
room situations, you should feel free to use the written 
synopses of the. category system included with the module • 
Also feel free to use the blank" coding slie^t's provided 
in the module. 
28 seconds] 

3 second pause 
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Having followed the instructiono you read prior to 
beginning this audiotape, you have already gotten a clock 
or a watch with a aweep second hand or a ctop watch. If 
you do not already have ouch materials available, pleaoe 
otop the tape and get them now if you wish to use them. ' 
[18 cecondfi] 



Background music is faded up for 10 secondo. 
/ 

Novr that you have the appropriate materials, please 
code the following seventh grade general science lesson. 

2 second pause 

TEACHER: Dip the end of that toothpick in that soap. Just the very 

end^ OK? (PAUSE) Now put it right in the middle. 
CHORUS: (UNINTELLIGIBLE) 
STUDENT: Smell of it. 

STUDENT: Lemme see that toothpick, Tracy. 
CHORUS: (UNINTELLIGIBLE) ^ 
TEACHER: V/hat happened Scott? 
SCOTT: (UNINTELLIGIBLE) ... the waves.' 
TEACHER: V/hat do you say Ricky? 
RICKY: I^d say it spreaded apart. 
CHORUS : (UNINTELLIGIBLE ) . . 
STUDENT: Hey man, you cheated a little bit. 
STUDENT: It's the soap . . • Gravity or something. 
SCOTT: It's the salt. ^ 
TEACHER: It's the salt? V/hy do you think* it's the salt somebody? 
Anybody? 

RICICY: Scott said it. Let him answer it. 

STUDENT: (UNINTELLIGIBLE) . . got lucky. It has to be something. 
SCOTT: Salt with soap combines \-rith the fat and it separates. 
TEACHET^: That's a good idea. Do~ you have any way ^that i^e could 

'test that? 
SCOTT: Yeah. \ 
TEACHER: How? \ 
CHORUS: (unintelligible) ^ 

STUDENT: . . . put salt on the dry deal and pour some of that in it 
TEACHER : What ' s that gonna show? 

STUDENT: Nothing. It's Just gonna get some soggy salt. 
STUDENT: If we could get ... 

STUDENT: If you vanna know if its Just the salt that's doing it . . 

(UNINTELLIGIBLE) . . . Just try to put salt in by intself . 
RICKY: Let's get a new bottle and see. what it'll do if we just stic 

the tooth pick in without anything on it . . . ' 
CHORUS:No. ... No salt Just pepper . . . (etc., etc) 
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STUDMT:. . . Somebody put their finger in there it oeparated . . . 
STUDETIT: . . .didn't make any difference. 

TEACHER: Ricky oayc the oalt didn't make any difference. Do any 

of the reot of you agKee with that? 
jStlJDET^T: Yeah I It muct be- the pepper that doep it, not €he calt. 
8TUDENT: (UKIUTELLIGIBLE) . . add com'e oalt. 
[2 minuteo] ^ 



Background fadeo back up for 12 seconds , then down to: 

Wow that you have finished coding thio short epixiode 
turn to page eleven of the key booklet. Stop the tape now 
and check your analysis- 

• <» 

Background comes back up and continues uninterrupted for IP seconds. 



Coding questions as they roll by you in an ongoing 
classroom situation is a much more difficult task than coding 
the transcripts. You must focus strictly on the questions, 
forcing yourself to ignore all the other interesting 
things that are going on around you. Now that you know how 
intensely you must concentrate, try to code' the next 
lesson for a 70% success level. 
cf 

Background music continues unabated for 5 seconds. 



TEACHER: OK, V/hat are some of the methods that work for birth 

control Kevin? 
ICEVIN: Uh . . . Uimrnn . . . Prophylactics? / 

TEACHER: Prophylactics. OK . . . Let's see, in what way do you 
think that would differ from the first two. we have here? 
(long PAUSE) Cecille, what do you think? 

Cecille Uh . . .. (LONG PAUSE) 

TEACHER: Do you think it would be anything like this one? (LONG PAUSE) 
l-Jhich one do you think it would be closest to? (LONG PAUSE) 

Cecille: Uh . . . (UNINTELLIGIBLE) . . . closest to sterilization. 

TEACHER: Sterilization. All right, who . . , who agrees with her 
there? Does anhtne . . . Sharon agrees with her, Bob, Kevin, 
OK. Then . . (UNINTELLIGIBLE) . . .explain how it would 
be like sterilization. How is it like sterilization? 

STUDENT: V7ell, like . . . (UNINTELLIGIBLE) 

TEACHER: That's it, that's good. That's a pretty good analysis of 
it. OK, let's movm over to one of the other methods then. I 
think that's a p/etty good analysis. Does anyone think that*^ 
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not fight? Thinko workc a flifferent way? . . . (UKinTELLIGIBLE) 
. . . like prophylaetico. She oayo it'o like cteriliz^tlon 
becauQe thereto no.^oemen there co you don't have any . . . uh 
. . • coming together of theoe two gometeo. \Jhat do you 
think Ruccell? Do you think that'q pretty clooe to right. 
RUSSEI.L: Yeah I think do, ... O.K. 

TEACHER: I would think it would be but maybe comebody would have 

a different opinion. Well, OK, let's go on to comethiiig elce then. 
.Uh . . . what do you think about the third one? Do you think 
it 'a a reasonable method of birth control? Abstinence? 

STUDENT: No. 

TEACHfift: O.K., V/hy? Why do you oay that? 

STljmUT: Well ... I don't know. 

TMCHER: Do you think rtt's very practical? ^ 

GTUDENT: No. * ' 

TEACHER Do you think it's reaoonable? 

STUDENT: (UNINTELLIGIBLE) v 

TEACHER: Porrect, do you think it^o praeticfal? , . . If aome 

country had problems and they wanted to limit their birth 
rate, do you think that's a reasonable . . . uh . . . method? 

FORREST: (UNINTELLIGIBLE) . . .can't go without it and they'll 

► sure think about it some time. 

CLASS: General Laughter 

TMCHER: O.K., Forrest . . . Explain that a little . . . People 

can't go T^ithout it, in other words it's unnatural. 
FORREST: (UNINTELLIGIBLE) 

TEACHER: O.K., that's good. That's right and ... it's a knovm 
*fact that they can't,, or they don't ... so it would be 

fairly safe to^ assume that they can't so . . . (UNINTELLIGIBLE) 

Sherry, do you have a question? 
SHERRY: Well, uh . . . (UNINTELLIGIBLE) . . . abstinence depends on 

who you are, like suppose . . (UNINTELLIGIBLE) . . . like, 

a scientist or something and you could get so busy that 

, , . (UNINTELLIGIBLE) 
FORREST: (UNINTELLIGIBLE) 
CLASS: General Laught,er ' ^ 

TEACHER: Allright, allright. Explain a little bit about what you 
mean. Explain a little bit about what you ihean when . . . 
(UNINTELLIGIBLE). 

SHERRY: (UNINTELLIGIBLE) 

TEACHER: V7ell , I think that's good. Does anybody disagree ^rith that? 
DEBBIE: (UNINTELLIGIBLE) • 

FORRE0T; Not everybody's gonna be that'a'way- 

TEACHER: Forrest, you say not everybody's gonna be that way, Debbie 
you said . . . (UNINTELLIGIBLE.) . . ,Earl, what do you think? 

EAPL: I think they gonna think about it one time or another. I mean 
. . . (UNINTELLIGIBLE). 
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CLASS: Genral LaughtQr- 

TEACHER: O.K., I think all of ya'll that r;aid that were partially 
correct. Thereto come people that it'n juot not ao much of a 
problem for them. They redirect. wHat they're doinf;; into . . . 
.(uninTELLIGIBLE) . . .creative ocientiotfl or rjomething. 
I think what Earl cald in true too. At one time or another 
every body thinks about it if they're anyt-rhere near normal 
at all. O.K., let*o . . . uh . . . let'o look at thx) next ^ 
one tiien. [Sterilization . Mary, what do you think? Do you 
think that' Pi a reaconable method of birth control? In that a 
reasonable method of birth control, r^ay, for poople in 
India? 

[^RY: Yeah, I think it io. 

TE)\CHER: How come? V/hy? (LONG PAUHE) 

MARY: Well ... ^ 

CTlJDm: Are yo^ talking about an a law or UN INTELLIGIBLE^? 

TEACHER: Ac a law. Something to limit their population. 

GTIJDENT: (UNINTELLIGIBLE) ... a population that'o rioen and like 

babies born and . . . 

HTUDENT: deplete the population! 

TEACHPJR: Ben, what do you think about that? Do you think it would 

do that? 
BEN: Naw. 

TMCHER: (UNINTELLIGIBLE! . . . vrhat do you think? Do you think 

it would* deplete the popVilation like hn naid? 
OTUDMT: If it did, it would tak9;a while. 
TEACHER: You nay i1f would take a while. 
[5 minutoG, ^fl aecondi)] v$ 



Background munic fadeo up for 12 r^econdr, , breakn for: 

The magic topic. DincuRr, nex and they're immediately 
attentive. Now that you have^'coded thic lenson, pleane turn to 
page 15 of the key booklet to check your analynio. Stop 
the tape now. 
(it Geconda] 

i • ' • 

Background mu3cl fades up for 12 neconds, thc^n breaks' for: 

TEACHER: Scott, let's hear your idea. How many dimensions does 

this have? 
SCOTT: One. 

TEACHER: One? VHiat is a dimensidn? Scott ?^'^ (PAUSE) Allright Mark! 
what are the three dimensions Scott? 
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GCOTT: Uh . (LONG. PAUSE) . . . length, depth and x-ridth? - 
TEACHER: Length, width and depth. Allright, what doeo thio 

oyotem >have? . « 

CHORUS; (UNINTELLIGIBLE) 

TP]ACHER: Length?^ , - / 

CHORUS: Yes 

TEACHER: And Width. Good' . - . ** 

STUDENT: It'o got depth too^ about fiye thounandthc of an inch. 
TEACHER: David nayo it haq depth of about five oeventho of im inch 
DAVID: Five thouoandthol / 
CHORUS: (UNINTELLIGIBLE) 



for about 50 cecondo, ctudentn chime in with id(?an but 

poorquality recording makeo underatandirig what they oay. 

too diffieujLt, to tranocribe. ^ , ' • 

V 

TEACHER: Let'q go back to the idea about >the dimensionn. Johnny, 

what'n different about thene two bottlec? 
JOHNNY: One'n fatter than the other one. One'fi . . . (UNINTELLIGIBLE) 
<^ TEACHI'JR: Do they both huve height? 

STUDENTS: Yac . 

TEACHER: Do they both have width? 

CHORUS: Yen. . - ' 

TEACHER: Do they both have- depth? 
CHORUS: No & "One of ,them doel"^ . 
' TEACHICR;- O.K., let's thinlt about it. Bryan, doeo thin have depth? - 
BRYAN: VThich one? 
TEACHER: Thic coke bottle. 
BRYAN: Not from in front. 
TFiACHER: How about now? 
BRYAN: Just a little bit. 

TEACHEI^: Juot a little bit. Art, do you think thin coke bottle han 
depth? * . • * 'c^ 

ART: No. 

BRYAN: If it didn't have depth It wouldn't be there, 

TEACHER: Did you hear Bryan 'g comment? If it didn't have depth it 

V70uldn't be here. 
CHORUS:- (UNINTELLIGIBLE) ' 



dincuG^sion in* not trannoribable for about 15 seconds 
due to poor technical quality of recording, 
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TEACHER: O.K, , We don't care how it comQS out. Mine 'come out 

• awkward too. Go ahead and -trj^, 
STUDOT: Well . . . uh . . \ (UUINTELLIGIBLS) 
TEACHER: Jimmy, how many dimensions does this coke have? 
. [3 minutes, 32 seconds] v 



Your eventual goal is jbhe ability to ode classroom 
questions at the seventy percent level. Listen to the following 
and rest fOE^^etfew minutes ybef ore proceeding to side B, 

/ . ^ ' ^ 

Background musci at this point is the-Tocatta mo^Bbient of J,S. Bach's 

>5 Partita Number 6 in E Minor. It require approximeSyely 6 minutes and 
/'38 seconds. •. - . ■ ' \ 



Please change the. tape to side B, 



'SIDE B ^ 

Side B begins with H0i'bie AancockJiS "Chamelon," a composition 

\ ] ^ . 

similar to Bird * s ^'Ethiopian Knig^tsV w;iich- develops rhythmic 
complexity via the incremental addition of instruments . "Chamelon^^ 
serves as the backgroufid music for all of Side B^, AppiK)ximately 
58 aeconds plays prior to the commentar/: ', ' ^ 

Anoth6;r resemblance that much of jazz and much of teaching 
have in c(5mmon is that things move so rapidly,- the practitioners" 
must work very hafd Just to keep up* In working thi'ough 
Side B you 'will co'^tinue cording classroom episodes from real 
science classes', checking your' analyses with the pages in the 
keyN> booklet Vhic?i are referred to in the lape* i 

If you find yourself miscoding a^epecific question category, 
' you should' r§vie-K t,he category by r^^ding the introduction 
•booklet* and,' perhaps, by reworking th^ appropriate section of 
the writtjpn program. . 
[33 seconds] 



IGT) 



Backgroxind music for 10 seconds to: 



TEACHER: O.K., see you've explained to these kids^ you know, the 
different ways that the heat, that the earth is heated. What 
covild you tell them? Some other signs to look for? Garry? 

GARRY: Uh . . . (UNINTELLIGIBLE) • . . look for clouds. 

TEACHER :^ O.K. , Clouds . -Clouds are actually one of the questio 
I was going to ask you. What about the clouds? What are 
. they? V/hat would you tell 'em Pat?- 

PAT: Some of ',em are watea? vapor. 

TEACHER: O.K., it's water vapor. V/hat are they condensed ar<?und? 
The waten Vapor? . . . Mitch? 

MITCH: Dust particles. - 

TEACHER: O.K.> dust particles . "V/hat about the way some clouds look 

xixffexent from other clouds? Right Ernie? 
ERNIE: No. ' , • . 

TEACHER: No? They all look the same, right? 
ERNIE: No they're . . . they're different. 

TEACHER: O.K., and what three ways do we have of classifying them 
Roxanne? 

ROXANNE: Cumxolus , strattus, and cirrhus. 
TEACHER. O.K.\ what's a cumulus, Renee? 
RENEE: They're light and fluffy. 

TEACHER. O.K., what kind . . . what S:ind of weather would you kind 
of expect with this, with white fluffy clouds out there? 
David? 

DAVID : . Fair weather . " ^ 

TEACHER: O.K., pretty good, right? . . , (UNINTELLIGIBLE) . . . 

O.K., what's the next type? Mike? 
MIICE: Strattus clouds. 

TEACHER: Strattus. What would you call that? How would you describe 
it? " 

MIKE: Uh . . . Just like a low thin layer? 

TEACHER: That's right. And what type of weather might you expect 

from . . . not all the "time but sometimes? JOEY? 
JOEY; Rainy? 

TEACHER: It might be rainy, right? It's gonna be a cloudy day . . . 

(UNINTELLIGIBLE) . . . sunlight. And the third type? Donald? 
DONALD: It^'s . . . uh . • . cirrhus? 

TEACHER: O.K., where would you find these cirrhus clouds, Mary 

Grac^? . * 

MARY^RACE: In the upper troposphere. 

TEACHER: 0,K., and how would you describe these? How are they dif- 
ferent from the others? 

MARY GRACE: They're like . . » uh • . . thin thin layers of like 
feathers, . , 
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TEACHEER: O.K. Vlhat about the characteristics of the molecules 

that differ from the other kinds Steve ' 
STEVE: (UNINTELLIGIBLE) 

TEACHER: 0 /K. , '^hey 're like frozen water vapor, right? Tobin? 
TOBIN: They . . uh . . . (UNINTELLIGIBLE) . . . and they're 

^usually way up high in the atmosphere. 
TEACHER; O.K., they're veiy high and they look like feathers. OTC.. 

So you're through* this. Vfliat are two terms these people would 
, need to know. . c . to under'stand about why it rains, 

things like this? Bariy? 
BARRY: (UNINTELLIGIBLE) - • * . 

EACHER: Well, that's important but what two terms even before you 

get to this? Tommy? 
TOMMY: Humidity, . . . (UNINTELLIGIBLE) 

TEACHER: Well, it has to do with water vapor and humidity. Don? 
DON: (UNINTELLIGIBLip) 

TEACHER:- It •'S got "to do w^h that too. Two terms here. If you 
didn't know this^ term you really wouldn't even know what 
dewpoint was. Joe? 

JOE: (UNINTELLIGIBLE) ... evaporation. 

"TEACHER: Evaporation. That's one of 'em. Ifliat's the other one 

Rick? VThat's the opposite of evaporation? 
[3 minutes, 6 seconds] 



Background Music fade^ up for 10 seconds to: 

To check your analyses, dburn to page l6 of the key 
booklet. Stop ^the tape now. 
[6 seponds] 



Background music for 10 seconds to: 



^ flow analyze the following eight grade life science lesson, 
seconds] 



TEACHER: Kathy, did you see a nucleus in the cells of th^ 

onion skin? 
KATHY: No I didn't. 

TEACHER: Theresa, did you see a nucleus in the cells of the 
onion skin? 
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THERESA: (UNINTELLIGIBLE) ^ V 

TEACHER iV/hat'd you see Theresa? 

THERESA: (UNINTELLIGIBLE) - ^ 

TEACHER: James, what'd you see in the Elodea? 

JATffiS: Uh . . . I saw . . . (UNINTELLIGIBLE)'. . inside the 

cell and some kind of . . (UNINTELLIGIBLE) ... and I 

saw a vein. ' - » 
TEACHER: Yau saw a what? * ^ 

JAMES:. A vein. ■ .\ \ • ' 

TEACHER:* A. vein? What does a vein^ look like? 

JATvIES: Well it's a long streak . . (UNINTELLIGIBLE) . • . leaf. 
TEACHER: A line that runs dovm the middle of a leaf? James, 

how'd you know it was a vein? 
JAMES: I 3ust looked at it. 

TEACHER: Microviewer? Kent, did you see the vein? 
ICENT: Yes. 

TEACHER :Did the cells loqk different in the 'vein than anywhere 

else ifi the leaf? ^ ° ' 

KENT: Yes. 

TEACHER: How did they look? 

KENT: (UNINTELLIGIBLE) . . in a str^^ht line. 
TEACHER: Good! Thery were straight. Way were they straight? 
KENT: Because the vein was stiiaight. ' 
TEACHER: Because the vein vms /straight? Gina, why would the 

cell& be straight in the vein? 
GINA: 1 don't know . , . (INAUDIBLE) . . . I don't know. 
^TEACHER: No, you've got a good idea. jFinish what you were saying. 
GINA: You know when the veins are . . . (INAUDIBLE). 
TEACHER. I couldn't hear the end. 
GINA: I don't know. 
STUDENT: (UNINTELLIGIBLE) 
TEACHER: I Couldn't hear her. 

STUDENT: She said the cells ar^e straight because the veins are 

straight and . . . (UNINTELLIGIBLE). .' 
TEACHER: Could ya'll hear back there? , » 

CHORUS: No.' i 

TEACffiER: She said the cells are straight because the veins are straight. 

The cells make up the straight veins- 
STUDENT: Well why are the veins straight? 

TEACHER: Why are t.he veins straight, GiR^? (PAUSE) Can you think of 
a reason? (PAUSE) Why is it straight instead of crooked- like 
this? 

GINA: Idon't know. 

TEACHER: You want 'to think about it a minute? (PAUSE) O.K. Carl? 

CARL: Well, wouldn't the cells take on the shape of the cell mem- 
brane . . . (unintelligible) . . . cell membranes were straight 
that's why the cell would be like that, - ^ 
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TEACHER: Alltight. David, I want to go back to this idea of 
why. the vqin is straight. Why don't you tell us why the 
' vbi)r*is Gt^«d.ght instead of being .crooked like this? ' ^ 

DAVID ^•~•Oue idea is that it ecrows toward, the sun and.. . - 

(UNINTELLIGIBLli;) . . . tieoause the nucleus Just goes * . 
toward the sun. Anyway, there's nothjlng .to stop i*, I ' * - 
mean if there's a twig in the way, it would, I mean the 
twig would be in the way go it . ^ . (UNINTELLIGIBLE) ... 
'grows toward the sun. . ^ 

TEACHER: That might be a real good reasqn why it grows straight* 

STUDENT; (UNINTELLIGIBLE) . , . grows toward the sun? 

STUDENT; Yeah, how come all trees aren't straight? 

TEACHER: V/hy aren't all 'treslx straight? ^ 

STUDENT: It might be planted crooked. ' 

TEACHIJ^: Do yoi^ think that has anything to do with it? 

STUDENT: It might. 

TEACHER: That's a good idea, c 

STUDENT :^ (UNINTELLIGIBLE) 

TEACHER: Right. 

STUDENT: It could have been split. 
TEACHER. It could have been -split. 

.STUDENT: There Could have been a rock on it, on top of the ^eedling 
' and ^the rocks made it grow off ta one side. 
TEACHER: Possibly. Possibly. Fred, did you have a comment? 
FRED: (UNtNTELLIGIBLE) ^ 

TEACHER: O.K., say that loud so they ca- hear you. 
FRED: (UNINTELLIGIBLE). 

TEACHER: Gina, does that molte sense to you? 
GINA: Uh-huh. 

TEACHER: It's a good idea, isn't it? 
[5 minutes, 15 secorids] 



Background Music for 12.5 seconds to: 



- To che|Ck vour analvsis^ turn to paae 13 of the kev booklet. 
Stop the, tape at the tone. .... (tone) 
fg seconds 1 



Background Music for 11 seconds to: 



Now analvze thi^ classroom lefeson. 
r 3 seconds] 
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TEACHER: O.K., ore there different kinds of energy? 
STUDENT: Yeo . 

TEACHER: O.K., vhat kindc of energy are'-there? 

STUDENT: O.K., -^here's light ener^ and heat energy and kinetic 

energy and . . . that'o it. ' • ' 

TEACHER; VHiat are the two "broad areao of enerw? There are two 

^,eneral areas and . . . (UNIKTELUGIBLE) . 
STUDENT: Kinetic is one of 'em. 
TEACHER: -O.K. kinetic is one of them. Bryan? 
BRYAN : (UNINTELLIGIBLE ) 

TEACHER* I said t'le 'e are two poosihle forms of energy. Ken oaid 

kinetic is one of them. VHiat'o *fehe other. 
BRYAN: Potential. 

TEACHER: Potential. That'c right. O.K., what's potential energy? 
STUDENT: It's energy »thfe^t * □ stored,. 

TEACHER: O.K., real good. Real gold. V/hat atout kinetic energy? 

What kind of energy io that? 
BRYAI^: (UNINTELLIGIBLE) V 

TEACHER: O.K., well now, we're'»ytalking about, potential and kinetic 

energy. Howdo we apply this to heat?*^. . . (UNINTELLIGIBLE) . 

. . . oaid that heat i,G energy, go how does this relate? 

Bryan? # * a 

BRYAU:' (UNINTELLIGIBLE) . well if something gets hotter, it " ' 

moyeG^faE^ter . 

TEACHER: O.K., when something gets hotter, it moves faster. Now, 

what do you mean by that? 
BRYAN: (UNINTELLIGIBLE) 

TEACHER: O.K., so by that I assume you mean that the molecules that 
are in** everything that are moving, . ^ O.K., v/hat about . ." , 
(UNINTELLIGIBLE) ... . V7hat is heat? (Sounds of teacher working 
at chalk board) . . . O.K., we're saying that everything 
has molecules in it and they're in motion- Do you think this 
can be applied to heat? 

[2 minutes, k2 seconds] 

Background music for 5 seconds to: 

To check your analysis, please turn to page 1^4. , . Stop 
the tape now. -v < 

[8 seconds] 

Background music for 5 seconds toi 



Now analyze the following short sequence 
^^[2 seconds] 
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TEACHER: * . . . additional things. Give me some cpecific b; pe 

things that you . . . 
STIJDEI^T: Like cuIdog. 
TEACHER: O.K. cubec are onp thing. 
STUDENT: Con^eo. 
TEACHER: ConeD. 
STUDENT :.i3pher%|3. 

TEACHER: Spheres VThat in yoxir every day life uses volume 

or \Tho user, volume? 
CHORUS: (UNINTELLIGIBLE) 
TEACHER: Nobody uses volume? 
CHORUS: (UNINTELLIGIBLE) 
TEACHIJR: You do? 
STUDENT: (UNINTELLIGIBLE) 

TEACHE'R: How . . ..Cleaning . . . (UNINTELLIGIBLE) . . . ?No, what 

. . . Ifow . . . VJhy do' you think that 'll volume? 
STUDLTJT: (UNINTELLIGIBLE) 

TEACHER. That is to say, how i^ it expreooed? \7hat Units? 
STUDENT: (UNINTELLIGIBLE) 

TEACHER (UinWTELLIGIBLE) .... in volume and gasoline in gallons ! 

Anything else? 
STUDENTS: (UNINTELLIGIBLE) 

TEACHER: All right, O.K., I guess they, charge by the cubic feet. 
Natural ic . . . that's how you pay for it, 'in cubic 
feet. VJater, liquids are all mec^Gured in volume. 

STODENT: Vmat about textiles? ' 

TEACHER: Textiles. All right let me . . . V/hat? ^ 
STUDENT: (UNINTELLIGIBLE) 

TEACHER: How . . . How would you . . . How . . . V/hat do you mean 

by textiles? Materials? 
STUDENT: Cloth, metal. 

TEACHER: And how would you buy a sheet of metal? V/hat are they 

expressed in? 
STUDENT: They're bought by the square yard, 

TEACHER: A^llright, that'd be area. If you . . . (UNINTELLIGIBLE) . 
squared, remember? Cause you had centimeters to the one, centi- 
meters to the two, centimeters to the three which is area would 
be ... wouold be square feet or whatever. A lot of building 
contractors figure their buildings by the square fQoi|. 

[l minute 38 seconds] * ' 



Background music fades in for 12 seconds to: 

! 

To check your analysis, please turn to page 12 of the key 
booklet. Please stop the tape. 
[6 seconds] 

• ■ A 



Background Muoic playo for 12 oeconda and fadeo down for: 



Your analyaio of queGtioning cklllc should be honed 
to a fine edge by thio time. You are now ready to take 
your final examination, Pleace code the following eighty 
grade earth ocience leooon for different types of quectiono 
asked. ' - ' 

[IT necondo]' 



TEACHER: Today we're gonna talk about economically valuable 

minerals. Dari^n, v/hat ' d, economically valuable minerals? 
DARIN: I don't know. 

TlilACHER: V/hat's economic • . . economics? 

DARlK:Oh that's . • . uh , , . sometin' like gold or diamonds. - 
TEACHER: Darin says economics is like gold or diamonds. Tammy? 
TATW: (UNINTELLIGIBLE )^ - 

TEACHER: O.K., Tammy nays economics , . . economically valuable 
minerals are ^nerals that are worth money. Do you agree 
with that Jimmy? . . / 

JM4Y: Yes. • 

TEACHER: Jirajny agrees. Allen? 

aIjLEN: Yeah,^ guess so. 

TEACHER: That's' what it is. The minerals that are worth money. O.K 
what I want to do is to put a list up here with' minerp4^s 

1^hat ya'll think i9.re worth money O.K., Ruben, 

give me a valu^^ble mineral. 

RUBEN: A valuable mineral? 

TEACHER: A valuab^-e mineral. , ' ' 

RUBEN. DiSmStia. 

TEACHER: Diamonds. . . . Joanne, can you name one? 

JOANNE: Uh . .• . ruby? ^ ' ' . ' 



JEFF: Gold. >|f 
TEACHER: Gold .... 
STUDEOT: Topaz. 

TEACHER: Do ya'll think , . . do ya*ll agree with Jeff that gold's 

a valuable mineral? , ' , 

CHORUS: Yes. 

TEACHER: O.K., Kevin, do you think gold's valuable? 
ICEVIN: (-UNINTELLIGIBLE) 

TEACHER: Well, what does that me^an? Yes 6r no? 
KEVIN: Yes. 

TEACHER: Yes. VJhy do you think gold's valuable? 
ICEVIN: ^Because it's hard to" find. 

TEACHER: It's hard to find, O.K., Michelle, do you agree that 

that's one rea^h why gold is valuable? Because it's hard to 



TEACHER: Ruby 



Jeff? 




find? 




172 



318 



MICHELLE: Yeah. 

TEACHER: O.K., why do you think it'c a criteria for beinn valuable? 
That it'o harql to find? V/hy ic.that a reaoon? I'm aoking 
Michelle. 

MICHELLE: Because if you can't find it, then it'o hard . . . 
ALLEN: If you can't find it, it'o' hard to make money on . . 
STUDENT No! . . . Mr Hq^rkinG!! 

TEACHER : O.K., Allen oaid that if you can't find it, you don't have 
that much. That'o what Michelle naid, and they oaid if you 
don't have much, it's worth more because people want it- 
It) that ^what you liaid, more or leoo? 

ALLEN: Yeah . . . (UNINTELLIGIBLE) . . . money on it. 

TI^CHER: Cpnnie? 

CONNIE: V/eil, if nobody has it, then come women like it. 
TEACHER: Ah! Connie oays it'a valuable because women like it and 

if they can have it and their friendn can't," that makea 'em 

feel ... 
STUDENT: Feel good ! 

DARIN: That'n a girl'o opinio, though. 
TEACHER: That'fi a girl's opinion uarin . 
DARIN: Number four can be sapphire. 

TEACHIJR: O.K., Darin cays the Tourth mineral can be sapphire . . . 

V7hy sapphire, Darin? 
DARIN: It's Just . . . 
JIMMY: It's pretty! 

DARIN: . pretty and the ladies like it and everybody likes it. 

TEACHER: O.K. Darin and Jimmy both seem to agree. Sapphire in 

pretty. Connie, if sapphire is pretty, why is it valuable?^) 
CONNIE: Because women vrill buy some of it, 

TEACHER: O.K., because vomen will buy some of it. Go will men.. 

Men '11 buy it . . . 
CONNIE: For their wives. 

TEACHER: Naw, they don't giv«^t to their wives- Only to their girl 

.friends. You don't give anything good to your wife. 
CHORUS: (UNINTELLIGIBLE) 
TEACHER: O.K., Jerry, number six'. 

imrDENTt Number five is turquoise, ^ 
TEACHER: It's WHAT? 
CHORUS: TURQUOISE!!! 

TEACHER: Turquoise. VJaitaminit ! You gotta pick' one that's easy 

for me to spell. Ifow do you spell that? 
CHORUS: (UNINTELLIGIBLE) 

TEACHER: Ya'll know what i^ means. Turquoise. Something like that 
Turla-fees. ..... turlcwe\s. 

CHORUS: /jeneral Laughter ^ 
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TEACHER: O.K./That'o J^rry'c. V/hy turquoioe? 

JERRY: Becauce it's pretty. -It'^s . . . uh ... good for jewelry 

and . . . it'o fli'etty whenever you got it. 
STUTOENT: It's hard to come by too. . 
STUDENT: I got number dIx. 

GTUDEWT: VJhat'n the. moot valuable mineral in the world? 
STUDENT Diamond. 

TEACHER: O.K., Connie, did you' have something to add to the 

converGation? . . . Shhh. . . Shhh. . . Conni?eVo talking. 
CONNIE: (UNINTELLIGIBLE) 

TICACHER: O.K.* Connie oayo a lot of thene miqeraln are valuable because 

of their hardneoc. How hard's a diamond? 
OTUDENT:|['he hardest thing on earth. 
TMCHE^: O.K., how hard's gold? 

iTIMT^Y: It's soft. It's soft but that makes it easy to shape. 
TEACHER: Jimmy says it's soft. That's one reason why gold is , 

valuable. Because it's soft and it's easy to shape. They can 

stretch it into these thin little wires. 
STODENT: Yeab, but they gut diamonds real good. 

TEACHI®: -Yeah, but diamonds Cut everything else real good. O.K., 

Kevin, number six. 
KL^IN: Jade. 
TEACIfliR: Jade. 

STUDIOT: That's like sapphire . . . because it's pretty. 
TEACHER: O.K., it's like sapphire like the others, like ruby 

and sapphire and turquoise, it's' pretty. 
DARII^: Mr. Harkins, I got one. " ' v 

TEACHER: Darin? 

DARIN: Am-the^ist? l^at's that word? 

STUDENT: »Amethyst. 

'TEACHER: Amethyst. O.K., Ainethyst. 

STUDENT: That's only semi-precious. ^ . 

DARIN: That means it's valuable, though. 

TEACHER: Semi-precious. V/lio said that? Tracy? V/hy is it a semi- 
precious stone? 
TRACY: (UNINTELLIGIBLE), 

TEACHER: He nays that the amethyst is not as valuable as sapphire 
because it's softer, it's . . . (UNINTELLIGIBLE) . . 
it fractures and ... , 

STUDENT: It can't be alloyed. 

TEACHER: It can't be what? 

STUDENT: Alloyed. Gold can -be alloyed so it'll be harder. 
TEACHER^ V/hat about sapphire? You can't make metal out of sapphire 
c^n you? 
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STUDEiraS: (UNINTELLIGIBLE) 

TMCHEIi: O.K., number ei^^ht. . . Raise your hand. VJho oaid . . . 

Allen and I7alter cald what? 
CHORUS: Cllver. ^ . - 

TEACHER: Good! Silver! . . .I'm wondering. Usually it's this oae and 

the^n this one, t'he first two. And this one. O.K., silver. V/hy , 

is it economically valuable Ifcrik? 
ERIK: Because a lot of silver is used in knives and forks and spoons. 
TI?:aCHER: Yeah, and it's used in teeth. ^ 
STUDENT: Teevees. ^ 
CHORUS: (UNINTELLIGIBLE) 

TIsIACHER: Waitominit, waitaminit. Jerry, what did you say? 
JERRY: Money. 

TEACHER: Money. V/hat do all these things have on 'em? 
STUDENT: Nickel. 
STUDENT Oliver! 
TEACHER: Silver. 

STUDENT: Nickel; It's nickel-plated copper. 
STUDENT: It's silver-coated. 
STUDENT:' I'll betcha. 
TEACHER: Nickel-plated copper. 
CHORUS: (UNINTELLIGIBLE) 

TEACHER: O.K., what'd they use to be before I96U? 
CHORUS: Silver! ! !- 
I'EACHER.: Silver. 
CHORUS: (UNINTELLIGIBLE) 

TEACHL*R: O.K., that's the reasofi why silver's valuable. Good, 

Jerry. Darin, you have another^ one? 
DARIN: Yeah. Nickel's a valuable mineral. 
TEACHER: Number nine! Nickel!! 
CHORUS; (UNINTELLIGIBLE) 
DAIUN: It's used for coins. 
• TEACHER: It's utied for coins. All these ... 

STUDENT: That's spelled v;rong. It's "-el" ^- 

TEACHER: O.K., "-el." O.K., Jeff? 

JEFF: Brass? 

TEACHER :^ Brass? 

ALLEN: (UNINTELLIGIBLE) 

TI'IACHER: V/hat M ygu say, All>n? • ^ *^ 

ALLEN: Copper. 

TEACHER: Copper. Excellent. 

STUDENT: That's expensive, too. 

CHORUS: (UrUNTELLIGIBLE) 

RUBEN: Footer, or whatever you call it. 

TEACHER: Oh, but Ruben, that's not valuable. Pearler's cheap. . . 



. . Good try. . • O.K., now yaMl think . Economically 
valuable mineralo are thooe . . . are thooe vhich are worth 
lotc of money. 
[9 minutes, 2h cecondo] 



Background mur/ic 5 oecondB to: 



Pleaoe turn to page l8 of the key booklet 
[2 cecondc] 



Background munic foi*^ 13 cecondn to: 

r ^ 

Congratulations. You have finally finiched the module with 
a coding accuracy at the 70^ level. Thin level io exceptiomUJ-y 
good and nhould not be Judged by the typical ten-point 
scale. A 10% accuracy level for coding quentiorus of thin nature 
would be equivalent to an A, not a C. Thir. in the end of the 
modul e . 

[l minute, 3 seconds] 
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